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REMARKS 

The specification has been revised to improve clarity and correct various self-evident 
errors in grammar, singular-versus-plural case, spelling, punctuation, capitalization, 
reference-symbol usage, figure numbering, and equation numbering. In addition, reference 
symbols separated fi'om items to which they refer to in the specification have been moved to 
locations directly after those items. The status of the additional U.S. patent applications cited 
on pages 19-22 has been updated. A redtmdant sentence has been deleted on page 24. 
Inasmuch as a relatively large numbers of changes have been made to the specification, a 
substitute specification is enclosed to facilitate printing of the patent. 

Claims 1-35 have been canceled. Claims 36 - 95 have been added and constitute the 
pending claims. New Claim 36-51 are device claims that basically replace original device 
Claims 1-8. New Claims 52 - 73 are device claims that basically replace original device 
Claims 9-23. New Claims 74 - 81 are method claims that basically replace original method 
Claims 24 - 27. New Claims 82 - 95 are method claims that basically replace original 
method Claims 28 - 35. 

Claims 1, 2, 6, and 9 have been rejected under 35 USC 102(e) as anticipated by 
Raghavan, U.S. Patent 6,421,381 Bl ("Raghavan 381"). Claims 3, 4, and 18 - 21 have been 
rejected under 35 USC 103(a) as obvious based on Raghavan 381. Taking note of the fact 
that Claims 36-51 generally replace Claims 1-8 and that Claims 52 - 73 generally replace 
Claims 9-23, these rejections are respectfiilly traversed insofar as they might apply to any of 
Claims 36-73. 

Raghavan 381 discloses a one-dimensional receiver system that includes equalizer 
403 which can be implemented as a decision feedback equalizer. Fig. 7 of Raghavan 381 
illustrates decision feedback equalizer 420 which appears suitable for implementing equalizer 
403, As shown in Fig. 7, decision feedback equalizer 420 performs multiplication and 
addition steps to produce feedback signal a'k- Adder 421 then negatively adds feedback 
signal a k to filtered digitized signal a k to produce equalized signal ak that goes to symbol 
selector (slicer) 404. Although Fig. 7 of Raghavan 381 illustrates feedback signal a k as 
being positively added to filtered digitized signal a k, it seems that feedback signal a k should 
be negatively added to, i.e., subtracted fi-om, filtered digitized signal a k to enable equalizer 
420 to operate in the desired feedback manner. 
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New independent Claim 36 requires that equalization be performed by going through 
a lookup table in a feedback loop. In particular, Claim 36 recites that "data for a feedback 
signal used by the equalizer in each receiver" of the claimed receiver system "for generating 
the current equalized value of that receiver's equalizer output signal" is "supplied from a 
lookup table as a function of at least one previous symbol provided from the corresponding 
symbol selector". 

Feedback signal a"k in decision feedback equalizer 420 of Raghavan 381 is produced 
by going through multiplication/addition steps rather than using a lookup table. Raghavan 
381 thus does not anticipate Claim 36. 

Also, Claim 36 recites a multi-dimensional decoder. Raghavan 381 deals with 
100Base-TX which is a one-dimensional signaling protocol. The MLT-3 decoder in 
Raghavan 381 is thus necessarily a one-dimensional decoder. Raghavan 381 lacks the multi- 
dimensional decoder of Claim 36. This is a separate reason why Raghavan 38 1 does not 
anticipate Claim 36. 

Nothing in Raghavan 381 would provide a person skilled in the art with any incentive 
or motivation for modifying decision feedback equalizer 420 to include a lookup table as 
recited in Claim 36. Nor would anything in Raghavan 381 provide a person skilled in the art 
with any incentive or motivation for modifying the one-dimensional receiver system of 
Raghavan 381 to produce a multi-dimensional receiver system that includes a muhi- 
dimensional decoder. For these reasons, Claim 36 is patentable over Raghavan 381. 

Claims 37 - 51 all depend (directly or indirectly) from Claim 36. Accordingly, 
dependent Claims 37 - 51 are patentable over Raghavan 381 for the same reasons as 
Claim 36. 

New independent Claim 52 is directed to a multi-dimensional receiver system formed 
with a group of one-dimensional receivers that utilize "sequence detectors". Unlike an 
equalizer that equalizes individual values of a signal provided as a stream of values, a 
"sequence detector" examines a sequential group, or sequence , of values in a stream of signal 
values and matches that sequence of values, as a sequence, to a sequence of symbols chosen 
from a predefined set of symbols. Claim 52 specifically recites that each receiver of the 
claimed receiver system includes "a sequence detector that performs sequence detection on 
an intermediate signal constituted with intermediate values comprising the filtered digitized 
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values or further values generated from the filtered digitized values to approximate sequences 
of the intermediate values, as sequences [emphasis added], to respectively corresponding 
sequences of 1-D symbols chosen from a set of predefined 1-D symbols". 

Raghavan 381 does not disclose a sequence detector or any other component that 
operates in the sequence detection manner recited for the sequence detectors of Claim 52. 
Hence, Raghavan 381 does not anticipate Claim 52. 

Furthermore, Claim 52 recites a multi-dimensional decoder. As indicated above in 
connection with Claim 36, a multi-dimensional decoder is not disclosed in Raghavan 381. 
This further distinguishes Claim 52 from Raghavan 381. 

Nothing in Raghavan 381 would provide a person skilled in the art with any 
motivation or suggestion for modifying the receiver system of Raghavan 381 to include a 
sequence detector. Similarly, a skilled artisan would find no motivation or suggestion in 
Raghavan 381 for changing its one-dimensional receiver system into a multi-dimensional 
receiver system having a multi-dimensional decoder. Claim 52 is thus patentable over 
Raghavan 381. 

Claims 53 - 73 all depend (directly or indirectly) from Claim 52. Accordingly, 
dependent Claims 53 - 73 are patentable over Raghavan 381 for the same reasons as 
Claim 52. 

Claims 5, 7, and 23 have been rejected under 35 USC 103(a) as obvious based on 
Raghavan 381 in view of Raghavan, U.S. Patent 6,415,003 Bl ("Raghavan 003"). Again 
noting that Claims 36-51 generally replace Claims 1 - 8 and that Claims 52 - 73 generally 
replace Claims 9 - 23, this rejection is respectfully traversed insofar as it might apply to any 
Claims 36 - 73. 

Raghavan 003 discloses a one-dimensional receiver system that includes equalizer 



204. Although Raghavan 003 mentions that equalizer 204 can be implemented as a decision 
feedback equalizer, Raghavan 003 does not present any decision-feedback implementation of 
equalizer 204. Raghavan 003 does, however, refer to, and incorporate by reference, 
Raghavan, U.S. Patent 6,1 15,418 ("Raghavan 418"), and Raghavan, U.S. Patent 6,038,269 
("Raghavan 269"). See the last full paragraph in col. 6 of Raghavan 003. 
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Raghavan 418, copy enclosed, is the direct parent of Raghavan 381 . Consequently, 
the incorporation of Raghavan 418 by reference into Raghavan 003 does not add anything 
more to the combination of Raghavan 381 and Raghavan 003 beyond what is explicitly 
disclosed in those two patents. In particular, the decision feedback equalizer "disclosed" in 
Raghavan 003 by way of the incorporation by reference of Raghavan 418 is simply 
previously described decision feedback equalizer 420 of Raghavan 381. 

Raghavan 269 is directed to a sequence detector for a receiver system. In its 
background section, Raghavan 269 discloses both linear equalizers and decision feedback 
equalizers. Fig. 3 of the backgroxmd section illustrates decision feedback equalizer 200 that 
performs multiplication and addition steps to produce a feedback signal on line 302. Adder 
300 then adds, presumably negatively adds, the feedback signal to a linearly equalized signal 
to produce a fully equalized signal on line 303 connected to symbol selector (sheer) 400 that 
selects suitable one-dimensional symbols. 

Fig, 6 of Raghavan 269 discloses a linear equalizer combined with a sequence 
detector. Fig. 7 of Raghavan 269 discloses a linear equalizer combined with a sequence 
detector having decision feedback. Although Raghavan 269 mentions that its sequence 
detectors can be used in both 100Base-TX and lOOOBase-T apphcations, Raghavan 269 does 
not appear to disclose a full receiver system, whether one-dimensional or multi-dimensional, 
that employs sequence detection. 

As mentioned above. Claim 52 requires that equalization be performed by going 
through a lookup table in a feedback loop. The combination of Raghavan 381 and Raghavan 
003, including the incorporation by reference of Raghavan 269, does not disclose this lookup 
table feedback limitation of Claim 36. Repeating what was stated above, feedback signal a"k 
in decision feedback equalizer 420 of Raghavan 381 is produced by going through 
multipHcation and addition steps instead of using a lookup table. The same applies to the 
feedback signal provided on line 302 in Raghavan 269. 

Nothing in Raghavan 381 and Raghavan 003, including the incorporation by 
reference of Raghavan 269, would provide a person skilled in the art with any motivation or 
suggestion for modifying the receiver system of Raghavan 381 or Raghavan 003 to use a 
decision feedback equalizer that employs such a lookup table in the equalizer's feedback 
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loop. Accordingly, Claim 36 is patentable over Raghavan 381 and Raghavan 003. The same 
applies to Claims 37-51 since they all depend (directly or indirectly) from Claim 36. 

As further mentioned above, Claim 36 recites a multi-dimensional decoder. Neither 
Raghavan 381 nor Raghavan 003, including the material incorporated by reference from 
Raghavan 269, discloses a multi-dimensional decoder. This fiirther distinguishes Claim 36 
from Raghavan 381 and Raghavan 003, and establishes a separate reason why Claim 36 is 
patentable over Raghavan 381 and Raghavan 003. The same likewise applies to dependent 
Claims 37-51. 

New independent Claim 52 similarly requires a multi-dimensional decoder. Since a 
multi-dimensional decoder is not disclosed in Raghavan 381 or Raghavan 003, including the 
material incorporated by reference from Raghavan 269, Claim 52 is patentable over 
Raghavan 381 and Raghavan 003. The same applies to Claims 53 - 73 due to their 
dependence from Claim 52. 

Claims 10 - 14, 17, 22, and 24 - 35 have been rejected under 35 USC 103(a) as 
obvious based on Raghavan 381 in view of Raghavan 269. Taking note of the that 
Claims 52 - 73 generally replace Claims 9 - 24, that Claims 74-81 generally replace 
Claims 24 - 27, and that Claims 82 - 95 generally replace Claims 28 - 35, this rejection is 
respectfully traversed insofar as it might apply to any of Claims 52-95. 

As mentioned above, independent Claim 52 requires a multi-dimensional decoder. 
Neither Raghavan 381 nor Raghavan 269 discloses a muhi-dimensional decoder. Claim 52 is 
thus patentable over Raghavan 381 and Raghavan 269. The same applies to Claims 53 - 73 
since they depend from Claim 52. 

Similar to Claim 36, new independent Claim 74 requires that equalization be 
performed by going through a lookup table in a feedback loop. Claim 74 specifically recites 
"accessing, for use in producing a feedback signal utilized in generating the current value of 
each equalization signal, a lookup table to obtain data as a function of at least one previous 
symbol of the corresponding symbol signal". For the reasons presented above in connection 
with Claim 36, Raghavan 381 does not disclose a lookup table employed in the feedback 
manner recited in Claim 74. Nor does Raghavan 269 disclose a lookup table employed as 
recited in Claim 74. Accordingly, Claim 74 is patentable over Raghavan 381 and 
Raghavan 269. 
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Claim 74 also recites "decoding the streams of 1-D symbols to produce a stream of 
multi-dimensional symbols". Neither Raghavan 381 nor Raghavan 269 converts one- 
dimensional symbols into multi-dimensional symbols. Consequently, Raghavan 381 and 
Raghavan 269 do not disclose the decoding act of Claim 74. This further distinguishes 
Claim 74 from Raghavan 381 and Raghavan 269, and is a separate reason why Claim 74 is 
patentable over those patents. 

Claims 75-81 all depend (directly or indirectly) from Claim 74. Hence, dependent 
Claims 75 - 81 are patentable over Raghavan 381 and Raghavan 269 for the same reasons as 
Claim 74. 

Similar to Claim 74, new independent Claim 82 recites "decoding the streams of 1-D 
symbols to produce a stream of multi-dimensional symbols". Since neither Raghavan 381 
nor Raghavan 269 discloses this decoding act, Clahn 82 is patentable over Raghavan 381 and 
Raghavan 269. The same applies to Claims 83 - 95 because they all depend (directly or 
indirectly) from Claim 82. 

In short, all of new Claims 36 - 95 have been shown to be patentable over the applied 
art. Accordingly, Claims 36 - 95 should be allowed so that the application may proceed to 
issue. 

Please telephone Attomey for Applicant(s) at 650-964-9767 if there are any 
questions. 
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EV 337115 605 US 



RespectfiiUy submitted, 

Ronald J. Meetin 
Attomey for Applicant(s) 
Reg. No. 29,089 
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DETECTOR FOR AN ETHERNET RECEIVER 

Peter J. Sallaway 
Sreen Raghavan 

BACKGROUND 

1. FIELD OF THE INVENTION 

This invention relates to digital communication 
systems and, more particularly, to a detection system 
and method for an Ethernet receiver. 

2 . DISCUSSION OF RELATED ART 

The dramatic increase in desktop computing power 
driven by intranet -based operations and the increased 
demand for time-sensitive delivery between users has 
spurred development of high-speed Ethernet LANs. 
100BASE-TX Ethernet, using existing category-5 copper 
wire, and the newly developed lOOOBASE-T Ethernet for 
Gigabit/s transfer of data over categoiry-S copper wire 
require new techniques in high speed symbol processing. 
Gigabit per second transfer can be accomplished 
utilizing four twisted pairs and a 125 megasymbol/s 
transfer rate on each pair where each symbol represents 
two bits. 

Physically, data is transferred using a set of 
voltages where each voltage represents one or more bits 
of data. Each voltage in the set is referred to as a 
symbol and the whole set of voltages is referred to as 
a symbol alphabet. In gigabit transfer, for example, 
data is usually sent with a set of five voltage levels 
(PAM-5) , each symbol representing two (2) bits. 

One system of transferring data at high rates is 
Non Return to Zero (NRZ) signaling. In NRZ, the symbol 
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alphabet {a} is {-1, +l}. A logical ^^1" is transmitted 
as a positive voltage while a logical '"0" is 
transmitted as a negative voltage. At 125 M symbols/s, 
the symbol rate required for Gigabit transfer over four 
5 category- 5 wires, the pulse width of each symbol is 8 
ns . 

Another example of a modulation method for high 
speed symbol transfer is MLT3 and involves a three 
level system. (See American National Standard 
10 Information system. Fibre Distributed Da.ta Interface 
(FDDI) -Part: Token Ring Twisted Pair Physical Layer 
Medium Dependent (TP-PMD) , ANSI X3 . 263 : 199X) . The 
symbol alphabet for MLT3 is {a}={ -1, 0, In MLT3 

transmission, a logical 1 is transmitted by either a -1 
15 or a +1 while a logic 0 is transmitted as a 0 , A 

transmission of two consecutive logic "l"s does not 
require the system to pass through zero in the 
transition. A transmission of the logical sequence 
("1", "0", "1") would result in transmission of the 
20 symbols (+1, 0, -1) or (-1, 0, +1) , depending on the 
symbols transmitted prior to this sequence. If the 
symbol transmitted immediately prior to the sequence 
was a +1, then the symbols (+1, 0, -1) are transmitted. 
If the symbol transmitted before this sequence was a 
25 -1, then the symbols (-1, 0, +1) are transmitted. If 

the symbol transmitted immediately before this sequence 
was a 0, then the first symbol of the sequence 
transmitted will be a +1 if the previous logical "1" 
was transmitted as a -1 and will be a -1 if the 
30 previous logical "1" was transmitted as a +1. 

The detection system in the MLT3 standard needs to 
distinguish between 3 voltage levels, instead of two 
voltage levels in a more typical two level system. The 
signal to noise ratio required to achieve a particular 
35 bit error rate is higher for MLT3 signaling than for 
two level systems. The advantage of the MLT3 system. 
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however, is that the energy spectrum of the emitted 
radiation from the MLT3 system is concentrated at lower 
frequencies and therefore more easily meets FCC 
radiation emission standards for transmission over 
5 twisted pair cables. Other communication systems may 
use a symbol alphabet having more than two voltage 
levels in the physical layer in order to transmit 
multiple bits of data using each individual symbol. 

In Gigabit Ethernet over twisted pair Category- 5 
10 cabling, for example, PAM-5 data can be transmitted 

over four twisted coppi^^j^ti*:^ at an individual twisted 
pair baud rate of 12 5 Mbaud, In PAM-5, data is sent 
with 5 voltage levels, designated as symbol alphabet 
{a}= {-2, -1, 0, 1, 2} although the actual voltage 
15 levels may be different from those. Each symbol, 

therefore, can be used to code more than one bit of 
data . 

Any other modulation scheme for symbol coding can 
be utilized, including quadrature amplitude modulation 
2 0 (QAM) . In QAM schemes, for example, the symbols are 
arranged on a two-dimensional (real and imaginary) 
symbol^ ^ o notcllationjc^ (xnstead of the^^ n o dimonoion^ 
constellations of the PAM-S^j^ MLT-3 symbol alphabets) . 

There is a need for transmitters and receivers for 

25 receiving transmission over multiple twisted copper 
pairs . , 

p&rirs^usxng larger symbol alphabets (i.e., 3 or more 
symbols) . There is also a need for transceiver 
(transmitter/receiver) systems that, while operating at 
high symbol rates, have low bit error rates. 



30 



SUMMARY 



Accordingly, a receiver and detection method for 
receiving transmission of data over multiple wires 
3 5 using encoded data symbol schemes having multiple 
symbols is described. A receiver according to the 
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present invention includes multiple detectors for 
detecting one symbol from each of the multiple wires 
simultaneously (i.e., multiple 1-D detectors), an 
equalizer coupled to each of the detectors for 
5 equalizing the symbol stream from each of the multiple 
wires, and a multi -dimensional error analyzer/decoder 
for simultaneously making ha r d-^ oo jr c i o ]\ regarding the 
symbol output of the symbols transmitted over each of 
the multiple wires. 
10 Individual symbols can have any modulation scheme, 

including those with multi -dimensional constellations. 
The terminology of detecting N-dimension^^simibols 
refers to the number of individual symbols detected in 
each clock cycle, and not to the dimension of the 
15 symbol constellation. 

Each of the equalizers can be any equalizer 
structure, including linear or decision feedback 
equalizers. In one embodiment of the invention, the 
equalizers include sequence detection equalizers. In 
2 0 another embodiment of the invention, the equalizers 
include simplified decision feedback equalizers . 

In another embodiment, the equalizer includes a 
sequence detection equalizer in combination with a 
linear equalizer or a decision feedback equalizer. In 
25 some embodiments, the sequence detection equalizer is a 
reduced state sequence detector. In some embodiments, 
the decision feedback equalizer is a simplified 
decision feedback equalizer. 

In. general, a transceiver according to the present 
30 invention can utilize any symbol alphabet. In some 
embodiments, a PAM-5 symbol alphabet is utilized. 

Some embodiments of the invention can also include 
an error analysis decoder. The receiver receives 
signals from N individual wires and, for each wire, , 
35 includes a linear equalizer in combination with a/^^r=^ 
sequence detector. The N output signals from the" N 1-D 
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sequence detectors are input to a N-D decoder that 
makes a final decision on the N-D symbol. In some 
embodiments of the invention, the error analysis 
decoder operates with lattice encoding schemes . In 
some other embodiments of the invention, the error 
analysis decoder operates with a parity encoding 
scheme . 

These and other embodiments of a transceiver 
system according to the present invention are further 
described below with reference to the following 
figures. 



BRIEF DESCRIPTION OF THE FIGURES 

Figure 1 shows a block diagram of a transceiver 
having multiple transport channels. 

Figure 2 shows a block diagram of an encoder 
capable of both trellis encoding and parity encoding. 

Figure 3 shows a trellis diagram for state^ 
transitions among subsets of SAi&^5^''Q&0si^ 

Figure 4 shows a block diagrarft of a model of 
transmission channel between a transmitter and a 
receiver system. 

Figure 5A shows a block diagram of a N-D receiver 
system according to the present invention. 

Figure 5B shows a block diagram of a receiver 
according to the present invention for the N-D receiver 
system of Figure 5A, 

Figure 6 shows a block diagram of a linear 
equalizer. 

Figure 7 shows a block diagram of the equalizer 
and decoder portions of a 4-D receiver system that 
includes linear equalizers and parity encoding. 

Figure 8 shows a block diagram of a decision 
feedback equalizer. 
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Figure 9 shows a block diagram of the equalizer 
and decoder portions of a 4-D receiver system that 
includes decision feedback equalization. 

Figure 10 shows a block diagram of a 4-D receiver 
system that includes sequence detection equalizers. 

Figure llA shows a block diagram of a sequence 
detector. 

Figure IIB shows a block diagram of an embodiment 
of an equalizer system. 

Figure 12 shows an example of a trellis diagram 
for state transitions between PAM-5 symbols. 

Figure 13 shows a block diagram of an embodiment 
of a sequence detector equalizer with decision feedback 
according to the present invention. 

Figure 14 shows a block diagram of an embodiment 
of a sequence detector equalizer having soft outputs 
according to the present invention. 

Figure 15 shows a block diagram of an embodiment 
of a parity code receiver that includes soft output 
sequence detection equalizers according to the present 
invention. 

Figure 16 shows an embodiment of a reduced 
complexity sequence detector having soft outputs 
according to the present invention. 

Figure 17 shows an example of a trellis diagram 
illustrating state changes between reduced states of a 
reduced complexity sequence detector, including 
multiple branches between states. 

Figure 18 shows a trellis diagram illustrating 
state changes between the reduced states of a reduced 
complexity sequence detector after branch path 
decisions have been made. 

Figure 19 shows a block diagram of a decision 
feedback equalizer having a simplified feedback section 
according to the present invention. 
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Figure 2 OA shows a sequence detector in 
combination with a decision feedback equalizer . 

Figure 2 OB shows an embodiment of the feedback 
section of the decision feedback equalizer shown in 
Figure 20A that includes a simplified feedback section. 

In the figures, components having similar 
functions are often labeled similarly. 



DETAILED DESCRIPTION 

Figure 1 shows a block diagram of a transceiver 
system 100 according to the present invention. 
Transceiver system 100 includes transmitter 101, 
receiver 107, and transport wires 103-1 through 103-N. 
A digital data stream is input to transmitter 101 by a-* 
host 150. Transmitter 101 includes encoder 102, which 
encodes the data for transmission over transport wires 
103-1 through 103-N, Transmission coupler 112 couples 
the encoded symbols received from encoder 102 to 
transmission channel 104. Data is output by 
transmission coupler 112 as symbols ak,i through ak,N 
over wires 103-1 through 103-1^ (collectively referred 
to as cable 103) , respectively, which are coupled 
between transmitter 101 and receiver system 107. Wires 
103-1 through 103-N can be of any transport medium or 
combination of transport media. Transport media 
include, for example, category- 5 twisted copper pair, 
optical fiber and coax cable. 

The index k in the above notation indicates the 
kth time cycle of the data transmission. The indicator 
N is an integer indicating the number of individual 
transport wires in cable 103. In general, any number 
of wires can be included in transceiver system 100. 
For gigabit transmission, N is usually four (4) , 
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indicating a four wire connection between transmitter 
101 and receiver system 107. Wires 103-1 through 103-4 
are often twisted copper pair. 

Transmission channel 104 collectively represents 
5 cable 103 and any distortion of the signals that occurs 
between transmitter 101 and a receiver 107. Each of 
wires 103-1 through 103 -N, along with output couplers 
of coupler 112 and input couplers of detector 108, 
/iiotor-fe^ signals as indicated by the associated 
10 transmission channel 104-1 through 104-N, respectively. 
The signals through wires 103-1 through 103 -N are 
distorted by channel functions fi(Z) through t^iZ) , 
respectively, and additionally suffer from a random 
noise addition n^^i through nk,N/ respectively. Receiver 
15 107 includes^ signal detector 108 and a decoder 109 

and ultimately outputs a data stream which corresponds 
to the data stream entering transmitter 101. 

In Gigabit Ethernet, transmission can be conducted 
on four twisted copper pairs (i.e., wires 103-1 through 
20 103-4 in Figure 1) in a full duplex fashion to achieve 
one gigabit per second throughput. >^IEEE 802. 3ab, 
Gigabit Long Haul Copper Physical Layer Standards 
Committee, 1997 (hereinafter "Gigabit Standard"). 
Transmitter 101 is coupled to ^ first host 150 to 
2 5 receive data for transmission over transmission channel 
104 to a second host 151 coupled to receiver 107. In 
general, first host 150 is further coupled to a 
receiver 111 for receiving data from transmission 
channel 104 and second host 151 is coupled to a 
30 transmitter 110 for sending data to transmission 
channel 104 . 

Although, in general, the detection system as 
described here is applicable to any scheme of data 
transmission (i.e., any symbol alphabet) over any 
35 number of transport wires (e.g., twisted copper pair), 
for exemplary purposes many of the examples below 
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specifically describe a PAM-5 symbol alphabet 
transmitted over four twisted copp^3j^4r^ as would be 
used in Gigabit Ethernet transmission over Category- 5 
twisted pair cabling. It should be recognized that 
other symbol alphabets and numbers of conductors can 
also be used and that one skilled in the art will 
recognize from this disclosure embodiments appropriate 
for other modulation schemes. 

Encoder 



According to the developed IEEE 802. 3ab standard 
for Gigabit Ethernet transmission, the transmitted 
15 symbols on each of four conductors 103-1 through 103-4 
are chosen from a five level Pulse Amplitude Modulation 
(PAM-5) constellation, with alphabet {a}={-2, -1, 0, 
+1, +2}. See Gigabit Standard. At each clock cycle, a 
single one-dimensional (1-D) symbol is transmitted on 
2 0 each wire. The four 1-D symbols, one on each of 
conductors 103-1 through 103-4, transmitted at a 
particular sample time k^^,*r-irs<^considered to be a single 
4-D symbol. In general, data entering transmitter 101 
can be encoded into a N-D symbol, instead of into N 1-D 
25 symbols, by encoder 102. Encoder 102 may be any type 

of N-D encoder, including a N-D parity code encoder and 
a N-D trellis code encoder. 

To achieve one gigabit per second communications, 
a gigabit ethernet transceiver needs to achieve a 
30 throughput of 250 Megabits per second over each of four 
transport wires 103-1 through 103-4. Therefore, at a 
125 MHz baud rate, two bits must be transmitted at each 
sample time across each wire of cable 103. Although a 
PAM-5 system is applicable, a four level PAM system, 
3 5 for example, does not provide redundancy which allows 
for error correction coding necessary to achieve a bit 
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error rate (BER) of 10"^°, as required by the Gigabit 
Ethernet standard. See Gigabit Standard. 

In addition, extra channel symbols are needed to 
represent ethernet control characters. Therefore, five 
5 level PAM (PAM-5) with either a parity check code or 
trellis coding is often utilized in Gigabit Ethernet 
transmission. According to the Gigabit standard, the 
trellis code is the only coding utilized. Alphabets 
having more than five level 1-D symbols may also be 
10 utilized for Gigabit transmission while achieving the 
required BER. 

At 125 Mbaud, each 4-D symbol needs to transmit at 
least eight bits. Therefore, 256 different 4-D symbols 
plus those required for control characters are 
15 required. By transmitting a 4-D PAM-5 symbol alphabet, 
there are 5^ = 625 possible symbols. This number of 
symbols allows for 100% redundancy in the data as well 
as for several control codes. Symbol alphabets having 
more than five symbols yield even greater redundancy. 

2 0 However, because of the difficulties in distinguishing 

between the higher number of voltage levels, higher 
error rates may be suffered in receiver detection 
systems, such as detector 108 of Figure 1. 

The Gigabit Ethernet standard^^^— 6^et<Gigabit 
25 Standard^ allows a trellis code. However, both a 4-D 
eight state trellis code and a 4-D parity code have 
been proposed. The trellis code achieves 6dB of coding 
gain over uncoded PAM-5 while the parity code achieves 
3dB of coding gain. While encoding, the choice between 

3 0 encoders can be encoded in a TX_CODING bit, which can 

be set to one for trellis coding. One skilled in the 
art will recognize that embodiments of the present 
invention are applicable to any error correction 
technique . 

35 
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'^4BCT^Gllis Encoding 

Trellis encoding in a conventional 4-D eight state 
code is described in Part II, Table IV of G. 
Ungerboeck, "Ungerboeck- Coded Modulation with Redundant 
Signal Sets, Part I and II", IEEE Conmunications, vol. 
24, no. 2, p^p. 5-21 (F^b., 1987) (hereinafter 

an eight state trellis 
ehccwtter ioo' similar to that described in Ungerboeck is 
shown in Figure 2. Trellis encoder 200 receives eight 
bits, bits 0 through 7, and outputs 9 bits, bits 0 
through 7 plus a parity bit, provided that TX_CODING is 
set to 1. The parity bit is produced from a rate 2/3 
memory 3, systematic convolutional encoder 201. 

Convolutional encoder 2 01 includes delays 2 02, 2 04 
and 2 06, each of which delays its input signal by one 
clock cycle. The output signal from delay 202 is XORed 
(exclusive-ORed) with bit 6 in XOR 203 and input to 
delay 204. The output signal from delay 204 is XORed 
with bit 7 in XOR 205 and input to delay 206. The 
output signal, from delay 206 is input to AND gate 207 
and input to delay 202. AND gate 207 generates the 
parity bit, which is one (1) if TX_CODING is one (1) 
and the output signal from delay 206 is 1, and zero 
otherwise. In embodiments that only utilize trellis 
coding (i.e., TX_CODING is always 1), AND gate 207 may 
be excluded from encoder 200 and the parity bit is the 
output signal from convolutional encoder 201. 

The two input bits to convolutional encoder 201 
(bits 6 and 7) , and the parity bit produced by encoder 
201 select one of eight subsets, DO through D7, of the 
4-D symbol alphabet. The nine output bits are mapped 
to one 4-D PAM-5 symbol that is then transmitted across 
cable 103 (Figure 1) as four 1-D PAM-5 symbols. 

Each 1-D PAM-5 symbol is a member of one of two 
families, X (odd) and Y (even) . The odd set X contains 
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the PAM-5 symbols {-1, +i} and the even set Y contains 
the PAM-5 symbols {-2, 0, +2}. Table 1 shows a 

^^A^^^^i^^ the eight subsets of 4-D symbols labeled 

DO , ^ 
^^POOthrough D7 . The definition is based on the 

5 membership of 1-D PAM-5 symbols that are represented in 

each subset. Table 1 also shows the number of 4-D 

symbols included in each of the subsets. 

The notation describing each subset indicates the 

families of 1-D PAM-5 symbols on each of the four wires 

10 describing membership in that subset. The notation 
XXYX, for example, indicates a set of four 1-D PAM-5 
symbols where the first symbol is from type X, the 
second symbol is from type X, the third symbol is from 
type Y, and the fourth symbol is from type X. 

15 Therefore, conductor 103-1 (Figure 1) carriers a symbol 
of type X, conductor 103-2 carries a symbol of type X, 
conductor 103-3 carries a symbol of type Y and 
conductor 103-4 carries a symbol of type X. 



Table 1 -- Mapping of 4-D symbols into sets DO through 
D7 



Subset 


X Primary Code 


Y Primary Code 


# of 
Symbols 


DO 


XXXX 


YYYY 


97 


Dl 


XXXY 


YYYX 


78 


D2 


XX YY 


YYXX 


72 


D3 


XXYX 


YYXY 


78 


D4 


XYYX 


YXXY 


72 


D5 


XYYY 


YXXX 


78 


D6 


XYXY 


YXYX 


72 


D7 


XYXX 


YXYY 


78 



The parity bit and bits 6 and 7 are input to set 
select 210 (Figure 2) . Set select 210 determines a 
particular subset selection p, indicating that subset Dp 
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of subsets Do through D7 has been selected. In one 
embodiment, subset selection p is determined according 
to the formula 



p = 4*BIT6 + 2*BIT7 + l*Parity, (1) 

where BIT6 is bit 6, BIT7 is bit 7, and Parity is the 
parity bit. 

A point within subset p is chosen by the six least 
significant bits of the input, bits 0 through 5. Bits 
0 through 5 are input to a 4-D PAM-5 mapper 211 along 
with the output of set select 210, %. 4-D PAM-5 mapper 
211 determines the 4-D PAM-5 symbol within set Dp which 
represents the eight input bits,^bits 0 through 7, and 
the parity bit. Each subset, ^^e^ through D7, contains 
more than the 64 points required to encode the six 
bits, bits 0 through 5. These additional points are 
either used as control characters or not used at all. 

The subset mapping shown in Table 1 is chosen such 
that the squared Euclidean distance between any pair of 
points in the same subset is greater than or equal to 
four (4) . For example, the squared distance between 
two points in subset DO can be expressed as (X11-X12) **2 
+ {X2i-X22)**2 + (X3i-X32)**2 + (X41-X42) **2. Because Xij = 
+2, 0, or -2, the shortest squared distance is (2-0) **2 
= 4, which occurs when only one value differs between 
the two points. In addition, the squared Euclidean 
distance between points in different even subsets is 
greater than or equal to 2 and the squared Euclidean 
distance between points in different odd subsets is 
greater than or equal to 2 . As also can be seen from 
Table 1, even numbered subsets (Dq, D2, D4, Dg) have an 
even number of symbols of type X and an even number of 
symbols from type Y while odd numbered subsets (Di, D3, 
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Ds, D7) have an odd number of symbols of type X and an 

odd number of symbols of type Y. 

Figure 3 shows a trellis diagram resulting from 

the convolutional encoder shown in Figure 2 . The 

states of the trellis in Figure 3, So through S-j , are 

determined by the bits in delay elements 202, 204 and 

206. The state Sq is determined by q=4* (the output 

signal from delay 202) +2* (the output signal from delay 

204) 4- 1* (the output bit from delay 206). The subsets 

Dp are determined by the transition from one state to 

4_i_ , . . subsets 

another as shown m Figure 3 . The-^^^b c op t Dp are given 

in Table 1. 

As shown in Figure 3, all transactions out of a 
particular state are either all even^^ubotatoq, (Do, D2, 
D4, and De) or all odd subsets (Di, D3, D5, and D7) . 
Similarly, the transitions into a particular state are 
either all even subsets or all odd subsets. The 
minimum squared distance between outgoing transitions, 
therefore, is equal to two (2) and the minimum squared 
distance between incoming transitions is also two (2) . 

As a result, the minimum squared distance between 
valid sequences is greater than or equal to 4, which 
can be seen from the fact that any two paths that 
originate from the same node and end at the same node, 
but diverge at some point in the middle, must then 
converge at a later time. Both the divergence and the 
convergence have a squared distance of at least 2, thus 
the total squared distance must be at least 4 . In the 
case where these two paths do not diverge, then they 
must contain different points from the same subset. 
Because the minimum squared distance between points in 
the same subset is equal to 4, the minimum squared 
distance between valid sequences is 4 . As is 
conventionally known, ^ c - horof or<» ^ a coding^ gain of 6dB 
with respect to uncoded PAM-5 constellations^lS^^^ 
experienced . 
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5 The 4-D parity code can also be transmitted using 

the same encoder, encoder 2 00 of Figure 2. To do so, 
the TX_CODING bit is set to zero. As a result, the 
parity bit produced by convolutional encoder 201 is 
always 0. Therefore, set select 211 always chooses 
10 even subsets (i.e., X=0, 2, 4 or 6) . The minimum 

squared Euclidean distance between any two 4-D symbols, 
therefore, is 2 and a coding gain of 3dB is experienced 
over uncoded PAM-5. 

15 Transmitter Coupler 

Transmitter coupler 112 (Figure 1) couples the N-D 
symbol from encoder 102 to transmission channel 104. 
In some embodiments, coupler 112 can include pre-coding 

20 of signals to each of lines 103-1 through 103-N. Some 
pre-coding may at least partially overcome the expected 
intersymbol interference effects experienced in 
transmiss ion channels 104-1 through 104-N, 
respectively. However, some pre-coding, such as partial 

25 response shaping, for example, may actually add to the 
intersymbol interference effects. 

Coupler 112 converts symbols received from encoder 
102 to appropriate voltages for transmission to 
receiver 107 through transmission channel 104. In many 

30 embodiments of PAM-5 transmission, for example, those 
voltages are (-1, -1/2, 0, +1/2, +1) volts 
corresponding to the PAM-5 symbols (-2, -1, 0, 1, 2), 
respectively. 

35 Transmission Channel Characteristics 
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An input symbol stream {ak,i} through {ak,N} is 
input to each of wires 103-1 through 103 -N, 
respectively, of transmission channel 104 (Figure 1) by 
transmitter 101. Wires 103-1 through 103 -N can be 
twisted copper pair, or some other transmission medium 
such as coaxial cable or optical fiber. Transmission 
channel 104 represents the effects that wires 103-1 
through 103 -N, transmission coupler 112 and receiver 
couplers in detector 108 have on the input symbol 
streams {ak,i} through {3Ly,^^}Kn transmission between ^ 
transmitter 101 and receiver 107. Each transmission 
channel 104-1 through 104 -N includes a corresponding 
one of wires 103-1 through 103 -N, respectively, for the 
symbol stream {ak,i} through {ak,N/ } respectively. 

Figure 4 shows a single transmission channel 104 -L 
that represents the Lth one of transmission channels 
104-1 through 104 -N, where L can be any one of 1 
through N. The symbol ak,L/ representing the symbol 
transmitted on wire 103 -L in the kth time period, is 
transmitted through transmission channel 104-L. The 
symbol stream {ajc.L} of Figure 4 can be NRZ, MIiT3 , PAM-5 
or any other symbol alphabet and modulation. The 
transmitted symbols in the sequence {ak,L} are members 
of the symbol alphabet {a} . In the case of five-level 
PAM signaling, the symbol alphabet {a} is given by {-2, 
-1, 0 +1, +2} . 

The channel ^ response 105 -L is represented by the 
channel f unction^^^et-W^ In Figure 1, each of conductors 
103-1 through 103-N can experience a different channel 
function fi(Z) through fN(Z), respectively. The 
addition of random noise nk,L in Figure 4 is represented 
by adder lOS-L. Again, in Figure 1 each of conductors 
103-1 through 103-N experiences a different random 
noise nk,i through nk,N/ respectively. The signal^ Xk,L 
suffering from channel distortion, random noise, and a 
flat signal loss^ is received by ^ receiver 107. 



612675 v3 ^ 



For the sake of simplicity, a baseband 
transmission system is assumed, although the techniques 
shown are easily extended to a passband transmission 
system. (See E.A. LeeandD.G. Messerchmitt, Digital 
5 Communications (1988)) It is also assumed that the 
channel model includes the effects of transmit and 
receive filtering. In addition, the transmission 
channel is assumed to be linear in that two overlapping 
signals simply add as a linear superposition. The Z- 
10 transfornj^ (see A. Oppenheim & R. W. Schafer, Discrete- 
Time Signal Processing (1989))^ of -the sampled transmission 
channel 104 -L shown in Figure 4 is given by the channel 
function polynomial 

15 fL(Z)=fo,L + fl,LZ-^ + . . . fj,LZ-^ + . . . + fR^LZ""", (2) 

where fo,L/ . - - / f j,L/ - • . , fR,L are the polynomial 
coefficients. The coefficient fj,L represents the 
dispersed component of the (k-j)th symbol present in 

2 0 the ak,Lth symbol and R is a cut-off integer such that 
fj,L for j>R is negligible. The polynomial fL(Z) 
represents the Z- transformation of the frequency 
response of the transmission channel (Z~^ represents a 
one period delay) . (See A. V. Oppenheim & R. W. Schafer, 

25 Discrete -Time Signal Processing (198 9)^)^ 

The noiseless output of the channel at sample time 
k is given by 



30 



r-k,L = fo,L * ak,L + fl,L * ak-l,L + . - . fR,L * ak-R,L/ (3) 



where, without loss of generality, fo,L can be assumed 
to be 1. Thus, the channel output signal at time k 
depends, not only on transmitted data at time k, but on 
R past values of the transmitted data. This effect is 
35 known as ''intersymbol interference" (ISI) . (See Lee & 
MESSERSCHMiTij)^ The ISI length of the transmission 



-17- 



612675 v3 

J J 



channel defined by Equations 2 and 3 is R, the number 
of past symbols contributing to ISI . 

Intersymbol interference is a result of the 
dispersive nature of the communication channel . The 
IEEE LxAN standards require that systems be capable of 
transmitting and receiving data through at least a 100 
meter cable. In many instances, a single symbol may 
affect symbols throughout the transmission cable. 

The noise element of the input signal is 
represented by the sequence {nk,L} . Therefore, the 
noisy output signal from transmission channel 104 -L is 
given by 

Xk,L=rk,L + nk,L, (4) 

where the noise samples {nk,L} are assumed to be 
independent and identically distributed Gaussian random 
variables (see Lee & Messerschmitt) with variance equal to 

Receiver 

of 

Figure 5A shows /anx a block diagram'^an embodiment 
of a baseband receiver system 500 according to the 
present invention. Other receiver systems may also 
utilize aspects of the present invention. Embodiments 
of receiver system 50 0 may include any number of 
transport wires 103-1 through 103 -N (with associated 
transmission channels 104-1 through 104 -N, 
respectively) carrying input signal streams Xk,i through 
Xk,N/ respectively. 

Receiver system 500 includes receivers 501-1 
through 501 -N, one for each of lines 103-1 through 103- 
N, respectively. Receiver 501- j, an arbitrarily chosen 
one of receivers 501-1 through 501-N, includes 
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f ilter/digitizer 502- j, equalizer 505-1, and 
coefficient update 506- j . Si gnal j^^ from wire 103-j^^ 
Q<:kyjJ 7^3fe^ received by f ilteiydigitizer 502-j . 
Filter/digitizer 502-j filters, digitizes and amplifies 
5 the signal Xk,j and outputs a signal yk,j. Equalizer 
505- j receives the signal yk,j, equalizes it to remove 
the effects of intersymbol interference, and outputs a 
signal a'k,j, whi^ch is the output signal for receiver 
501- j . Filter/Digitizer 502-j can be arranged to 
10 include filters that partially remove the ISI 

interference from signal Xk ^ before digitizing the , , 
signal. /^ee, e.g. , ^Application-^ ^orial^ No. [Attornoy V^ 
.-£>e€ lr o t No. n n7G9] ^ filed on the same date as the 
present application, yS^ft^ assigned to the same assignee 
15 as the present application, herein incoirporated by 
reference in its entiretyJifc. i , ^ 

Coefficient update 506 -j inputs ^jdecided gtk symbols 
ak,j and other parameters and adapt ively chooses 
parameters for filter/digitizer 502-j and equalizer 
20 505-j (e.g., amplifier gain, multiplier coefficients, 
filter parameters, echo cancellation, NEXT 
cancellation, and timing parameters) . 

One skilled in the art will recognize that each of 
receivers 501-1 through 501-N can be dif f erent.ti-^-t5rr^^ 
2 5 each of^t ^iltorG ^ 5 02-1 through 502-N and equalizers 505- 
1 through 505 -N can be individually matched to receive 
input signals from the corresponding one of wires 103-1 
through 103 -N. ^ 

Figure 5B shows a representative example'^receiver 
30 501- j . Receiver 501-j is one of receivers 501-1 
through 501-N. Receiver 501-j incfife'sV^'*'^'^'^^^ 
receiver/digitizerj 502- j in series with equalizer 505- 

j. Receiver/digitizer 502-j includes, in series, 
^ -1*. ^/ ^cMcetl^r 

f ilter^/echo-;>a«e^ieaE^ 508-^, analog- to-digital 
35 converter (ADC) 509-j , and amplifier 510- j , One 

skilled in the art will recognize that the order of 
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{{<o(x\ i^a^ siDo^(\ in Pig* ^6. 

these components can be altered^ For example, 

amplifier 510-j can be implemented befpre filter 503 4^ 
, f f r imply ^iJi^e P Ts^ae- j/> or filler 
filter/echo cdnceller^ 508 - j^^can be irlqplemented, 

completely or partially, digitally after ADC 509-j . 

5 ^P^rameters to control the components of receiver 

^02-5^ ©kn be adaptively chosen by coefficient update 

506- j . Coefficient update 506-j adaptively determines 

the equalizer coefficients of equalizer^ 505-j, the 

gain gj of amplifier 510-j, the timing coefficient Xj of 

10 ADC 509- j, and filter coefficients for filter 508- j . 

In some embodiments, coefficient update 506-1 can 

calculate a baseline wander correction signal^ vmich is 

subtracted from the output sample of ADC 509-j at 

baseline wander correction adder 511 -j , Baseline 

15 wander correction is discussed in ^ E^ital D ajj oli^ ; ^ ; ^ 

jyan d er Correction Circuit iC ;^ U.S. Patent Application^^Ws^, 

.097151,525, filed July 11, 1998 , ^;S*^ee«-^ Raghavany: ^ 

•assigned to the same assignee as the present 

rii srl ntfure ,4^herein incorpoxated by reference in its 

20 entirety. 

Some embodiments of receiver 501-j include a cable 

quality and length indicator 512 -j that indicates a 

wire length L and wire quality Q. 

Echo noise, which is a result of impedance 

25 mismatches in the duplex link causing some of the 

transmitted signal energy to be reflected back into a 

receiver, and near end crosstalk (NEXT) noise, which is 

caused by the interference from a transmitCer/^llO 

(Figure 1)^ physically located adjacent to receiver 107, 

30 can be canceled through adaptive algorithms in filter 

508 -j . The cancellation of echo noise and NEXT noise 

is nearly complete because receiver system 500 has 

access to the data transmitted by an adjacent 

transmitter (transmitter 110 in Figure 1) . Coefficient 

35 update 506-j, therefore, may input parameters from a 

decoder/slicer, host 151 or other controller in order 
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to adjust filter 508- j to cancel echo and NEXT noise. 
Note that, in Figure 1, transmitter 101 may also be 
adjacent to an accompanying receiver 111. 

Filter 508-j can also include an anti-aliasing 
5 filter. An anti-aliasing filter prevents aliasing by 
passing the input signal, received from wire 103-j , 
through a low pass filter to reject out -of -band noise. 
As such, any conventional anti-aliasing filter can be 
utilized as an anti-aliasing filter portion of filter 
10 508-j . 

The analog-to-digital converter (ADC) 509-j 
samples and holds the input signal for a duration of 
the symbol period T, which in one embodiment of the 
invention is 8 ns. In general, embodiments of the 
15 invention can utilize any symbol period. Techniques 
for analog-to-digital conversion that can be used in 
ADC 509-j are well known. The digitized signals in the 
receiver are interchangeably referred to in this 
disclosure as samples or signals. 

20 Amplifier 510-j amplifies the samples received 

from wire 103 -j through transmission channel 104 -j in 
order to correct for signal loss during transmission. 
The gain'^of amplifier 510-j^^p can be adaptively 
chosen by coefficient update 506 -j in order to optimize 

25 the operation of receiver 501- j . One of ordinary skill 
in the art will recognize that di^Utal, amplifier 510-j 
can be located anywhere in receiver''*.&4s^=^ between ADC 
509-j and equalizer 505- j . In general, amplifier 510-j 
can also be an analog amplifier located anywhere 

3 0 between input channel 104 -j and ADC 509-j . 

In some embodiments, coefficient update 506 -j can 
also calculate the length and quality of wire 103 -j . 
Cable length and quality determination is discussed in 
U.S. Patent Application^/N<5s^ 09/161 , 346 , ^ ''Cabla L c ingfch s, 

35 , cmd Quality IxiJlcaLc yy^ filed September 25, 1998, 

^ r e en jW^Raghavan^ ^n d Doug J. — EaotorK ^ assigned to the 
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same assignee as the present . diooloaurs ^"^ herein 
incorporated by reference in its entirety. 

The output sampl^from receiver/digitizer 502 -j^ 
^y^^ is input to equalizer 505-j . Equalizer 505- j can 
5 be any kind of equalizer structure . Types of equalizer 
structures include linear equalizers, decision feedback 
equalizers, and sequence detection equalizers. 
Equalizers of these types for 100 or 1000 BASE-T 
Ethernet over category- 5 wiring, 24 gauge twisted 

10 copper pair, are described in ; ^Imp3rovQd Dotoction - ^ - o^ ^ 

-4- H ^ . . Pa-teot 

X^igit^l Gommum cat ion Receivers; , U . S .-^Application 

08/974,450, filed November 20, 1997, ^^^^eerr^. Raghavan, 
assigned to tjie same assignee as the present 
applicatxon,Aherein incorporated by reference in its 
15 entirety; and ^ ^fii^plificd Equaliser - for Twisted Pa-i - ^ 
j:hannQl ; \ U. S^.^^plication ^^fo^ 09/020,628, filed 
February 9 , 




same assignee as the ^'resent ^i . Gclo&uro >^ herein ' ^ 
incorporated by reference in its entirety. 
20 Additionally, receivers of the type described 

above as receivers 501-1 through 501-N are further 
described in ^ Digital Baseline Wandor CorroGticm 
Circuit U. S.-A AppllbQtion No ^ 09/151,525^ fdlcd Jul>^ 
> 11; 19Q G , — S i gei i A . R a yh ava M ^^ and /J. 0. FaLeiiL 
25 -T^^^gA iratirr t n No , 09/161,346, ^ '^Cablc Length and Quality 

.^■^ ^iratnr^^ , — fil^H c;f.phf.mh.«=^T' ^ iji 'iri , i w 

^^..fe Kj h aTran and - Doug- J. Eacton -yv ^""^h^y^^F-^hi rh y^=]^r^ -r'^-^r^y^ 
rbe en inrnrporat e d by roforonoo s^^ 

In receiver system 500 of Figure 5A, the output 

amples'^f rom receivers 501-1 through 501-N,^ 'k^'^ 

Decoder 507 
ymbol based on the samples from ^ j^d ^ 
receivers 501-1 through 501-N. Each of the N 1-D 
symbols of the N-D symbol is the result of the N-D 
35 symbol pick in decoder 507. 



30 



(5 . ^ 

ythrouQh a v w/lare input to d^nr^d^T qn7 

'I ~ ^-3 pe of \v el^ 5 

decides on a N-D symbol based on the s 
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Figure 6 shows a block diagram of a linear 

equalizer 600 having R+1 multipliers, where R is any 

integer greater than or equal to 0. Linear equalizer 

600 includes delays 601-1 through 601-R connected in 

5 series. The ^utput samples from /Kich - o& delays 601-1 

through 601-R'^^ also input to multipliers 602-1 

Vk 

through 602 -R, respectively. The input sample^ to 
equalizer 600 is input to multiplier 602-0. The input 
samples to multipliers 602-0 through 602-R are 
10 multiplied by the corresponding one of multiplier 

coefficients Co through Cr, respectively, and summed in 
adder 603. Multiplier coefficients Co through Cr can be 
adaptively chosen to optimize the performance of 
equalizer 600. In Figure 5B, for example, coefficient 
15 update 506 -j adaptively chooses equalizer parameters 
for equalizer 505- j . 

Equalizer 600 (Figure 6) executes the transfer 
function 

7= Q + C,Z-^ + + CjZ-' + + . " (6) 

For simplicity, the wire designation L has been 
neglected. It is understood that each transmission 
channel ^^ncludes a separated equalizer, each of which 
can be^^^errsL of equalizer 600 having its own transfer 
function T. 

In a zero- forcing linear equalizer (ZFLE) , the 
transfer function T is the inverse of the frequency 
response of the channel f(Z) (see Equation 2 with the 
wire designation L neglected) . In a minimum mean 
squared error based linear equalizer (MMSE-LE) , the 
transfer function is arranged to optimize the mean 
squared error between the transmitted data signal and 
the detected data symbols. A compromise, then, is 
found between the un-canceled ISI and the noise 



25 
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variance at the output terminal of the equalizer. (See 
B. Sklar, Digital Communications, Fundamentals and Applications 
(PTR Prentice Hall, Englewood Cliffs, NJ, 1988)^ 
The output sample from linear equalizer 600, 
executing transfer function T, is given by 



where Co through Cr are the equalizer coefficients, yk-j 
is the input signal to equalizer 600 during the time 
period periods before the kth period, and k 
represents the current time period. 

The output sample ^from equalizer 60 0^^a^ is 
usually input to a slicer 604 which decides, based on 
its input sample a'k, what symbol a^ was transmitted 
during time period k. The symbol ak is chosen from the 
symbol alphabet used for transferring data that is 
closest to input signal a'k. 

A linear equalizer can be implemented using either 
parity coding or trellis coding systems. When linear 
equalization is used with parity coding, a separate 
linear equalizer is used on each transport wire. In 
Figure 5A, for example, each of equalizers 505-1 
through 505 -N can include a linear equalizer. ^ Tho 
output — sampler from oaah of equaliGorc 505- 1 throu g h 
^ 05 N i r f input to rl R ^odcr 507, v/hich <3ho n n or T tb o^-^aest 
gppropri nto mul t a, d i monaional (N - B -) — oymbo3- > 

As an example. Figure 7 shows a portion of a 4-D 
receiver system 710, which includes 4-D decoder 700 and 
linear equalizers 600-1 through 600-4. Linear 
equalizers 600-1 through 600-4 provides equalization 
for each of channels 104-1 through 104-4, respectively. 
Decoder 70 0 can be any type of decoder including a 
parity code decoder and a 4-D trellis decoder. As an 
example, decoder 700 is shown as a parity code decoder. 
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Also, although a 4-D decoder is shown in Figure 7, it 
is understood that in general receiver system 710 can 
have any number of parallel input signals. 

The input samples to linear equalizers 600-1 
through 600-4^ corr e cponding tee the output samples^rom" 
^QCQivor/digitigG3s ;^^502-I through 502-4 (Figure 5B) , 
> yhich ia giveii by ^k,! through yk,D /3 ample 
respectively. The subscripts 1-4 reference each of the 
four wires 103-1 through 103-4, respectively. The 
output samples ^from linear equalize rs 600-1 through 
600-4^ ^ro given by ^\^i through a\^ respectively , ^^^em^ 
are input to slicers 604-1 through 604-4, respectively. 
In Figure 7, slicers 604-1 through 604-4 are 1-D 
slicers. If PAM- 5 symbol coding is utilized, then 
slicers 604-1 through 604-4 are 1-D PAM-5 slicers that 
each output the PAM-5 symbol closest to input sample 
a'k,x through a'k,4, respectively. 

The^ output sy mbol s^ from slicers 604-1 through 604- 
4, {^k.i through a^^T ^ respectively, are input to parity 
check 702. Additionally, each of samples a'k,i through 
a k,4 is subtracted from the corresponding one of symbols 
ak,i through ak,4/ respectively, in adders 701-1 through 
701-4, respectively, to calculate errors ek,i through 
ek,4/ respectively. In general, ^hen ^ the error signal 
ek,i, where i is 1 through 4, is^>^iven by 



^*./=«M-^M • (8) 

The parity of the 4-D symbol that results from the 
four ID symbols is cvl^ecked in parity check 702. In 
parity coding, th^'^^Bt^^ymbol is chosen from an even 
subset of all 4-D symbols. Therefore, if PAM-5 coding 
is used, there are an even number of PAM-5 symbols from 
family X (odd symbols) and an even number from family Y 
(even symbols) . Parity check 702 checks the parity of 
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the four input symbols, a^,! through ak,4, by determining 
whether the sum of the four symbols is even or not. An 
odd parity indicates that there is an error in at least 
one of the decided symbols a^,! through ajc,4- The result 
of the parity check is input to final decoder 704. 

The calculated error signals e^,! through ek,4 are 
input to error analysis 703 . Error analysis 703 
determines which of the four error signals e)c,i through 
e)c,4 is greatest and the sign of that error. Error 
analysis 703 outputs a sign signal^^ sgn\ and an 
identif ier-Af or the symbol having the greatest error» 

Final decoder 704 inputs the parity signal from 
parity check 702, the four 1-D PAM-5 symbols^^Trom 



slicers 604-1 through 604-4^ (a^^i thr ough ^a jc^ 

respectively, the ident i fiery fc^ the symbol having the 
greatest error^(wjr and the sign^f that error^--©^*i^ and 
outputs the PAM-5 symbols a'k i through a'k 4 in response.. 
If the parity is ^J>b«fi the 4-D symbol defined by^ 

a'k,i through a'k,4 is-^given by a^,! through ak,4, 
respectively. The parity coding scheme, therefore, 
will pass erroneous^^ife^ symbols containing simultaneous 
errors in two of the 1-D symbols. 

If the parity is odd, however, the results of 
error analysis 703 are used to correct the output 
symbols. Because the symbol having the greatest error 
is the one that is most likely incorrect, the value of 
the symbol indicated by identifier W is corrected by 
either increasing or decreasing that symbol by one 
symbol in the symbol alphabet in response to the sign-'^ 
of the error (in this example, increased for a positive 
sign and decreased for a negative sign). The new set 
of four symbols, the three uncorreicted symbols having 
the lowest error and^ the corrected symbol, is output as 
the 4-D symbol defined Joy'^a through ak,4- 
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Although simple to implement, the primary 
disadvantage of a linear equalizer is that, while 
removing the ISI from the input signal, it may cause 
the random noise to be enhanced. This is especially 
true in twisted copper pair channels where the 
frequency response of the channel has significant 
attenuation across the transmitted signal bandwidth. 
Hence, in twisted-pair channels, such as is used with 
gigabit ^^thernet, linear equalization often does not 
perform well enough to be practical. 

Figure 8 shows a decision feedback equalizer 800. 
Decision feedback equalizer 800 include f oj- waj-d v 

section 810, a feedback section 811 and^adder 804. 
Feedforward section'^includes delays 801-1 through 801-M 
coupled in series, multipliers 802-1 through 802 -M 
coupled to receive the output signals from delays 801-1 
through 801-M, respectively, multiplier 802-0 coupled 
to receive the in^ut sample to decision feedback 
equalizer 800, and-'^adder 803 coupled to receive the 
output signals from each of multipliers 802-0 through 
8 02-M. The output signal from each of multipliers 8 02- 
0 through 8 02-M is the input signal to that multiplier 
multiplied by the corresponding one o^^^^ ^od - f orward -^ 
multiplier coefficients Co through Cm. ^^JIq^- f Q.rwajg4>, 
multiplier coefficients Co through Cm can be adaptively 
chosen in order to optimize the performance of the 
equalizer. In Figure 5B, for example, coefficient 
update 506 -j adaptively chooses equalizer coefficients 
to optimize the performance of receiver 501- j . 

Adder 8 03 (Figure 8) sums the output signals from 
each of multipliers 802-0 through 802-M, Feedforward 
section 810, therefore, executes the transfer function 
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The output signal from feedforward section 810, 
therefore, is given by 

= Qy, + Qy,_, + ... + Cjy,_j + ... + Cj^y,_j^ , (10) 

where yk-j is the input sample to equalizer 800 during 
5 the (k-j)th time period. Again, the wire designation 
has been neglected for simplicity and it is understood 
that each of receivers 501-1 through 501 -N (Figure 5) 
includes an equalizer 505-1 through 505-N, 
respectively, any of which can be a decision feedback 
10 equalizer 800 (Figure 8) . 

One embodiment of feedback section 811 includes 
delays 805-1 through 805-P coupled in series. 
Multipliers 806-1 through 806-P are coupled to receive 
the corresponding output signals from delays 805-1 
15 through 805-P, respectively. Multipliers 806-1 through 
806-P multiply each of their input signals by the 
corresponding one of feedback multiplier coefficients Bi 
through Bp, respectively. Feedback coefficients Bi 
through Bp also can be adapt ively chosen. Adder 8 07 
20 sums the output signals from each of multipliers 806-1 
through 806-P. Feedback section 811, therefore, 
executes the transfer function 



=B,Z-' + ... + 5^Z-^. (11) 

^ T 

^euau'&e^l^^ ^^^^^ signal to feedback section 811 is 
25 symbol a^* '^?Le^%ift^u1^'' signal from feedback section 811 
is given by 

< = + B^a^_^ H- • • . 4- B^a^^^ . (12 ) 
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A second embodiment of feedback section 811, which 
is later discussed in this disclosure, is shown as 
feedback section 1905 in Figure 19 and includes look-up 
table 1906. 



section &10^(a'^ in adder 804. The input signal to 
slicer 808, then, is given by 



Slicer 808 outputs the symbol ak that is closest to the 

input signal a'"k. 

A decision feedback equalizer operates on the 

principle that if the past transmitted data is 

correctly detected, ^J^feen the ISI effects of these past 

data symbols can-^Se canceled from the currently 

^^|ived sample. As such, ^,.©^^^*i^ feedforward section 

810^contains no multipliers (i.e., Co = 1 and all other 

__. . ^ o^toet ^q/tspi^ ^aaai^ Xk* 

coefficients are 0) and>*a k /-- yk/ thc ^ input sample^^ 

Past detected data samples contain no noise and 
therefore decision feedback equalizers do not suffer 
from noise enhancement. However, decision feedback 
equalizers do suffer from the effects of error 
propagation. If slicer 808 erroneously decides a 
previous symbol, the error will be propagated into 
subsequent decisions . 

Figure 9 shows the equalization and decoder 
sections (see Equalizers 505-1 through 505-4 and 
decoder 507 of Figure 5, for example) of a-^Efi, receiver 
910- The equalization is accomplished using four 
decision feedback equalizers, one for each of the four 
input channels shown. Again, one skilled in the art 
will recognize that a receiver can have any number of 
input channels and that a 4-D receiver is shown here 
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for example only. In Figure 9, receiver 910 includes 

4-D decoder 900. Although decoder 900 is shown as a 

parity code decoder, it is understood that decoder 900 

can be any 4-D decoder. One skilled in the art will 

5 recognize that 4-D decoder 900 must correct symbols 

within a sinqle clock cycle so that the results can be 

fed back tfirough^ ^D teip ^ 811-1 through 811-4 to correct 

symbols a'k,i through a'k,4, respectively. 

The equalization for channel 104-1, for example, 

10 IS accomplished by feedforward sectxon^810-l , feedback 

section 811-1, and adder 804-1. Similarly, channels 

104-2 through 104-4, each includes the corresponding 

ones of feedforward';ite-a^pfe^ 810-2 through 810-4, 

respectively, f eedback^^Jtape^ 811-2 through 811-4, 

15 respectively, and adders 8 04-2 through 804-4, 

respectively. 

Samples yk^i through yjc,4 originate from receiver 

input signals received from channels 104-1 through 104- 

4, respectively- Samples yk,i through yk,4 are received 

2 0 into feedforward taps 810-1 through ^ ^ ^ ——^^ 

respectively. The symbol outputs'^ from decoder 90 0»^^.iT\^ 

^hrough a \^4y ^corre sponging co a single 4-D symboT^ are 

input to feedback taps 811-1 through 811-4, 

respectively. As was discussed with relation to Figure 

25 ^8, the output signa l^from each of feedback sections 

811-1 through 811-'47 Ya' through ei' respectively, 

is subtracted from the corresponding one of the output 

("""signals^ from feedforward sections 810-1 through 810-4, 

r- r — ^ eddti of 

\a. k,i through a k,4> respectively, in'^adders 8 04-1 through 

30 804-4, respectively. The o utput signals^ from adders ^ 

804-1 through 804 -4^( a' ^ through a''\^ respectively, 

are inputted to decoder 900. 

In an embodiment where decoder 90 0 is a 4-D parity 
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( ^ode decoder, the^input signals^to decoder 900^^^''\^ ^ 
V ^hrough ei"\^^/ are received Jpy slicers h>"ui-i tnrougri 
901-4, respectively. Each of slicers 901-1 through 
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901-4 decides on an output symbol^ ak,i through ak,4/ 
respectively, based on its corresponding input signal^ 
a k,i through a'"k^4, respectively. The output symbols 
from slicers 901-1 through 901-4 are inputted to parity 
check 903 and final decoder 905. 

Parity check 903 sums the>*^^l^symbols ak,i through 
ak,4 and determines whether the ^^iB^-*symbol is of even 
parity or odd parity. In parity coding using PAM-5 
symbols, the ^^4^ symbol is chosen from an even subset 
and therefore each>»^^ symbol includes an even number of 
1-D PAM-5 symbols from family X (odd parity) and an 
even number from family Y (even parity) . Therefore, 
the sum of the 1-D PAM-5 symbols is even. If the 
par^ity of the 4-D symbol is even, final decoder 

905<^outputs the symbols ak,i through ak,4 as output 
symbols a'k,i through a'k,4j r^5/>e^-^>>^€*l/* 

Error signals ek,i through ek,4 are calculated in 
adders 902-1 through 902-4, respectively, by, in each 
of the transport channels, taking the difference 
between the output symbol^of slicers 901-1 through 901- 
"^/ {^k,! through ak,4) respectively, and the corresponding 
one of the input signals^ a"'k,i through a"'k,4/ 
respectively : 



^*,i==</-^t.,w i = l, 2, 3 or 4. (14) 

The error signals'^at j oaoh of^ slicers 901-1 through 901 
4^-^re inptit to error analysis 904. Error analysis 904 
determines which of the symbols ak,i through ak,4 is 
associated with the largest error signal ek,i through 
ek,4/ respectively, and the sign of the largest error. 
Error analysis 904 outputs an ident if iei^of the symbol 
having the largest absolute error^(*w]; and the sign^of 
that error^ (S^ )^ to final decoder 905, If the parity 
signal indicates odd parity, the erroneous symbol is 
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most likely to be the one with the largest error, 
indicated by identifier W. Final decoder 905, then, 
adjusts the symbol having the largest error up or down 
the. symbol alphabet by one symbol depending on the sign 
5 SGN (in this example, up if the sign is positive and 

down if the sign is negative) and outputs the resulting 
4-D output symbol defined by a'k,i through a'k^4. 

The combination of N-D trellis code encoding with 
a DFE architecture requires a DFE on all four wires for 
10 each state within the trellis (see, e.g.. Figure 3). 
The DFE output at a particular state is used for 
parallel branch decisions and branch metric computation 
for the branches leaving that state. The equalization 
in this situation uses a process called ^'per survivor 
15 processing", described more fully in Riccardo Raheli, 
Andreas Polydoros, Ching-Kai Tzou, "Per-Survivor 
Processing: A General Approach to MLSE in Uncertain 
Environments," IEEE Trans. Commun. , Vol. 43, No. 2/3/4, 
pp. 354-364, February/March/April 1995, incorporated by 
20 reference in its entirety, to determine the feedback 
symbols , 

The multiple decision feedback equalizers in the 
trellis decoder helps to minimize the effects of error 
propagation. However, a DFE architecture suffers from 

25 the disadvantage that it does not utilize the sample 

power contained in the intersymbol interference caused 
by the dispersion in the channel. More particularly, 
information about a 1-D symbol being transmitted during 
a time period k is contained in future received 1-D 

30 symbols from that channel and DFE does not utilize this 
signal power in deciding the currently received symbol . 

A third type of equalization, sequence detection, 
does not suffer the performance degradation of either a 
linear equalizer or a decision feedback equalizer. 

35 However, a typical sequence detector produces hard 

outputs that can severely limit the performance of an 
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error correction code. According to the present 
invention, a soft -output sequence detector is provided. 

As an example. Figure 10 shows a portion of a 4-D 
receiver utilizing sequence detection according to the 
present invention. The receiver shown in Figure 10 
includes sequence detectors 1001-1 through 1001-4, one 
for each of the four transmission channels 
corresponding to wires 103-1 through 103-4. One 
skilled in the art will recognize that a receiver can 
include any number N of transmission channels, each of 
the transmission channels providing signals to one of N 
detectors. Some or all of the N detectors can be 
sequence detectors . 

^^The output sampled fr om sequence detectors 1001-1 
through 1001-477|j k.i through Sj^^ respectively, along 
with the second best output samples^ a2k,i through a2k^4^ 
and the errors Ai through A4 are input to decoder 1002. 
Decoder 10 02 decides on the receiver output samples^ 
a jc,i through a'k,4^ based on, for example, the parity 
coding scheme or the N-D lattice coding scheme. One 
skilled in the art will recognize that the decision of 
decoder 1002 can be based on any coding scheme that can 
correct errors in one clock cycle. Feedback is 
provided to sequence detectors 1001-1 through 1001-4 so 
that future sequences are decided using the results of 
the N-D decisions. 

Figure llA shows a block diagram of a sequence 
detector 1100 for the PAM-5 symbol alphabet, {a}={+2, 
+1, 0, -1, -2}, where the intersymbol interference 
includes the effects of only one other symbol, i.e., 
the ISI length 6 is one (1) . In general, sequence 
detector 1100 can utilize any alphabet and any number 
of ISI symbols (A>2 and 5>1) . Dietector 1100 includes a 
branch y?etric generator 1101, an ^dd-§ompare-^elect 



/irst-^ut (LIFO) buffer 1104, and a starting point 
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determiner 1105. Seguence detectors apre discussed in 
U.S. Patent Appl t r^^t- -i ^m-^Td^ , t ) P/Q7^ , 4^^- - -^ypr^f r. ^.f j f^-v^ 
. D i gital. Communication Rcceiv e ro,^" — tQ - gr^j Q n Raghavan - T' 
wh i ch hao been prmrj nrirrr l y incorporatGd by roforoncc 

The ISI addressed by the embodiment of detector 
110 0 shown m Figure is caused by just one 
previously transmitted symbol. Thus, the input sample 
to sequence detector* 1100 is given by 



^k.y. = + ^l^A-l,w , (15) 

where^ ai,„ is the equalizer ISI coefficient, hk,w is the 
noise component of the output signal from the linear 
filter over^wire w and ak,w is the transmitted symbol 
over wire w received in time period k. The sequence 
detector estimates the transmitted data sequence {a^^w} 
from the seque nce of received samples {rk^^} • 

The state^f detector llOO^^^S^^) defined as the 
past data symbol estimates. In general, a system with 
a symbol alphabet having A symbols and which suffers 
intersymbol interference from 5 previous symbols will 
have A possible states. Each state corresponds to a 
possible transition path through the 5 previous 
symbols. For example, a system using a symbol alphabet 
with two symbols, {a} = (+1, -i}, and suffering ISI 
from two past symbols, 8=2, will have four possible 
sequence states of the system: symbol +1 at time k-2 
and symbol +1 at time k-1; symbol +1 at time k-2 and 
symbol -1 at time k-1; symbol -1 at time k-2 and symbol 
+1 at time k-1; and symbol -1 at time k-2 and symbol -1 
at time k-1. Sequence detector 1100 for the example 
embodiment shown in Figure llA, a PAM-5 symbol alphabet 
with ISI resulting from one symbol, has five states -- 
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+2, +1, 0, -1, and -2 corresponding to the five 
symbols in the PAM-5 alphabet {a} . 

A trellis diagram depicting a state transition 
from time (k-1) to time k for sequence detector 1100 is 
5 shown in Figure 12. A trellis diagram provides a 
graphical mechanism for predicting what the signal 
output would be for the channel in transitions from one 
state in time k-1 to another state at time k. As an 
example, from Equation 15 above, and neglecting noise, 
10 a transition from state +2 at time k-1 to a state +1 at 
time k results in a signal input to sequence detector 
1100 of l + 2aw,i. 

In sequence detector 1100 shown in Figure llA, yO\ 
branch metric generator 1101 generates distance metrics 
15 corresponding to the branches illustrated in the 

trellis diagram of Figure 12. The distance metrics 
represent the difference between the input signajl to 
branch metric generator 1101^ ^^j^^^ and the calculated 
signal that is expected to be observed in each of the 
20 allowed transitions of a trellis diagram. In general, 
if there are A^ states of sequence detector 1 1 0 0^ ,fei*ei?i) 
there are A^"^^ branch metrics to calculate. In some 
embodiments, however, not all branches are allowed and 
therefore the number of branch metrics is reduced. 
25 For PAM-5 signaling suffering from one ISI symbol, 

there are twenty five (25) distance metrics Mk,w. The 
twenty five (25) distance metrics generated by branch 
metric generator 1101 for the case where ISI is the 
result of one past symbol and neglecting random noise 
30 (i.e.^A=5, 5=1 and fw(2) = l+aw,iz'^) are given by: 

Mk,w(0) = [rk,w- (-2-2aw,i) ]^• Mk,w(13) = [rk,w - (aw,i) ]^• 

Mk.w(l) = [rk,w- (-2-aw,i) ] ^- Mk,w(14) = [rk,w- (2aw,i) ] ^; 

Mk,w(2) = [rk,w- (-2) ] ^• Mk,w(15) = [rk,w- (l-2aw,i) 1^; 

35 Mk,w(3) = [rk,w- (-2+aw,i) ] ^• Mk,w(16) = [rk^w (l-aw,i) 1 ^• 

Mk,w(4) - [rk,w- (-2 + 2aw,i) ]2; Mk,w(17) - [rk,w-l] ^; 
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Other metrics which represent the difference 
between the input symbol and the predicted input 
symbols, assuming each of the possible state 
transitions, may be used as distance metrics. In 
general, there will be a distance metric for every 
transition from any state S' at time k-1 to state S at 
time k, A '^f or a metrics system with A symbols and 5 
interfering symbols if all transitions are allowed. 
PAM-5 symbol ing is shown here only as an example and 
embodiments of detector 1100 can utilize other symbol 
alphabets and more ISI symbols. 

Add-compare- select J ^Q^\ circuit 1 102 in Figure 
llA updates a state metric^'^for each possible state of 




the sy s t em^ j deno t ed by Pk,w(+2) , Pk,w( + 1) / Pk,w (+0) , 
Pk,w(-1)/ and Pk,w(-2) in the PAM-5 example, / ^at each time 
step k. For the PAM-5 symbol alphabet the state 
metrics are given by: 



Pk,w(i) = minj = {_2,-i,o,i,2}{pk-i,w(j ) +Mk,w ( ( j +2 ) +5 ( i+2 ) } ; 
for i={2,l,0, -1, -2} . (17) 

In general, the state metrics represent the 
accumulated distance metrics of past states along 
transition paths that minimize the accumulated distance 
metric. Therefore, the t ransition metric^ for state S 
at time period )5^ ^k,w (sT ) is the accumulated distance 
metric for previous states along a transition path 
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which ends at state S at time period k, state S being 
one of the possible states of the system. At time 
the state of the system may be at any state S' in the 
group of possible states of the system. Therefore, 
5 Pk.w(S) is the minimum one of Pk-i,w(S') plus the distance 
metric for transition from S' to S. A mathematical 
proof that this technique results in the least 
detection error is given in the Appendix of > 3:mproved > 
^Qtootion for Digital Commun ic at i on RocQivorQ U.S.-'v 
10 Application 08/974 , 450^ e/^^d ohcVe^ 

In the example of Figure llA, the comparison 
results^ D3c,w (+2) , Dk,w( + 1), Dk,w(0), Dk,w(-1) andDk,w(-2)^ 
are stored in a memory of traceback circuit 1103 for 
each of the five states. The comparison results 
15 indicate the state at time period k-1 which results in 
the state metric Pk,w(S) for state S at time period k. 
In the PAM-5, 6=1 example shown in Figure llA, the ACS 
results for each of the five states are given by 



20 



Dk,w(i)=j if Pk,w(i) = Pk-i,w(j) +Mk,w( (j+2) +5 (1+2) ) ; 
for i={2, 1, 0, -1, -2} ; j = {2, 1, 0, -1, -2} , (18) 



In general, Dk,w(S) points toward the state S' at time 
k-1 from which results the lowest state metric for 

2 5 arriving at state S at time k. 

When it is time for decoding, traceback circuit 
1103 traces back from a starting state, and fetches the 
data from memory in traceback circuit 1103 . 

In one example of a traceback, if the traceback 

3 0 depth is 2*TB, then it is expected that a traceback of 

TB is performed every TB/2 sample times and traceback 
circuit 1106 outputs TB/2 data symbols. With little 
loss of generality, TB can be an even integer such as 
6, 8 or 16. A greater traceback depth will result in 
3 5 less error in determining the final sequence of 

symbols. Greater traceback depths, however, incur an 
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implementation cost of requiring more memory in 
traceback circuit 1103. 

During the traceback procedure, ^ starting state 
determiner 1105 picks the^ starting state, which can be 
5 based^on the state metrics >rK,w^(c , i^ ^ Traceback circuit 
^J^i-O^-^follows the sequence back through the comparison 
results stored in memory in traceback circuit 1103. 
The earliest TB/2 symbols, which result in the earliest 
states, are written into last-in-first-out ^.i^i-PS^ 
0 buffer 1104 . The new comparison results are stored in 
the memory locations previously occupied by the 
outputted results. 

Traceback circuit 1103 determines the optimum 

sequence of symbols based on the state metrics 

% P^aVV^'?^. Scored ^ , 
5 ^J'ni q c hcf I ul-o d <^i n starting state determiner 1105. 

Starting state determiner 1105 initializes the 

traceback procedure by setting a starting sequence. 

LIFO 1104 simply time-reverses the data coming out 

of traceback circuit 1103 because the traceback is 

0 performed from the current time to previous times. 



Sequence Detection with Pre -Equalization 

When the channel ISI length 6 is large, or if the 
transmitted symbol alphabet size A is large, the above 
method of full sequence estimation becomes impractical 
at high symbol rates. Full sequence estimations 
require the implementation of states in the detector. 
Accordingly, ^^rt^ equalizer 1110 can provide pre- 
equalization by preprocessing the input samples yk,w in 
order to reduce the number of ISI symbols to be 
processed by sequence detector 1100. Equalizer 1110 
can be any equalizer that reduces the number of ISI 
symbols. Again, for purposes of example, assume that 
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the channel input alphabet size is A=5, i , e {a} = { +2 , 
+1, 0, -1, -2} , and that the reduced ISI length (as 
seen by the sequence detector) is 5' = 1. As before, the 
technique is applicable to larger alphabets and may 
accommodate more than one interfering symbol in the 
reduced length. 

The output of the equalizer 1110 with A=5 and 8'=1 
is^^^ o/proviouJly uei^iCi. Ib e^ given by 

3rk,w=a]c,w+aw,i*ak-i,w+hk,w/ (19) 

where aw,i is the equalized ISI coefficient and h^ is the 
noise component of the output of the linear equalizer 
1110. The transfer function (in Z-transform notation, 
^ee A. V. Oppenheim and R.W. Schafer, Discrete-Time Signal 
Processing, (1989)) for equalizer 1110 is^ then^ given by 

Ew(z) = (l+aw,iz-^) /fv,(z) . (20) 

The coefficient a„,i is chosen to minimize the noise 

variance at the output of the equalizer. Equalizer 

1110, therefore, is a reduced sequence equalizer 

because it reduces the ISI length from 5 to 5' . The 

reduced ISI length 5' is one (1) in this example. 

In one embodiment, reduced sequence equalizer 1110 

is implemented adaptively. One architecture used for 

adaptive implementation is shown in Figure IIB, In 

this embodiment, equalizer 1110 includes a linear 

equalizer 1120 implementing a transfer function C(Z) = 

l/f(Z) = Co + Ci^-^ + , . , + C6Z'^, adaptively followed 

by a filter 1121 implementing the function + . 

• • +aw,5'Z" ) . By implementing both equalizer 1120 and 

filter 1121 adaptively, optimal performance can be 

achieved for any cable length. Linear equalizer 1120 

can be adaptively implemented by using the least mean 

s 

squares (LMS) algorithm (^ee E.A. Lee and D.G. 
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Messerchmitt , Digital Communications (1988)) and a finite 
impulse response filter as shown in Figure 6. 

The coefficients a^^i through Ow^s' can be chosen 
adaptively in the sequence detector by observing the 
frequency response of linear equalizer 1120. From 
linear equalizer 112 0, the channel frequency response 
is deduced and aw,i through a^^s' can be selected from a 
look-up table. In one embodiment with 6'=1, two 
possible values of aw,i (0 and 1/2) are used. One of 
the two possible coefficients is chosen for aw,i by 
observing the two largest equalizer coefficients of 
linear equalizer 112 0, Co and Ci . For example, in one 
,g inbodim o nt G^^if Ci/Co < -0,5 then aw,i = 0.5, otherwise 
aw,i = 0. 

The benefits of combining linear equalization wit 

sequence detection include (a) reduced complexity in 

the sequence detector, especially for large ISI 

lengths, and (b) reduced noise enhancement in the 

linear equalization. . ..^ 

coi^n^ctLon With no 
In the example described in'^Figure ''^Jr^ with 5'=1, 

the number of states in the sequence estimator is 

reduced from 5^ to 5 . The reduced state sequence 

estimator can be implemented using the Viterbi 

algorithm. 

Sequence Detection with Pre -equalization and Decision 
Feedback 

Figure 13 shows a receiver 1350 that includes an 
embodiment of a sequence detector 13 00 having decision 
feedback. In this embodiment, equalizer 13 01, which a 
before can be any equalizer structure, pre -equalizes 
transmission channel 104 -w to a pre -determined ISI 
polynomial G„(z) of length ti<5, ^here 5 is the ISI 
length of the frequency response*^^^^rf*i of transmission 
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one 

channel 104 -w. In^Jfe+t^ example^ Fi r guro - 11 ^ r| is 2 and 
the ISI polynomial G„(z) is given by 

Gw(z) = 1 + aw.iz'^ + cxw,2z'^- (21) 

5 

The transfer function of equalizer 13 01 is given by 

Ew(z) = Gw(z) /fw{z) . (22) 

10 Sequence detector 1300 includes branch metr;;LC . 

generator 13 02, add compare select^ 13 03, traceback-^ 
1304, LIFO 1305 and starting point determiner 1306. In 
general, the detection technique implemented in 
sequence estimator 13 00 may be used for any combination 
15 of 5 and ti such that r|<5. Although the technique may be 
implemented with any sized alphabet, the example shown 
in Figure 13 is for the PAM-5, (A=5) , alphabet. The 
coefficients, otw,i and aw,2/ can be chosen adapt ively to 
optimize performance of the receiver 1350. 
2 0 To perform the sequence estimation using the 

Viterbi algorithm, as outlined above, sequence detector 
13 00 is still implemented with twenty five states (if 
the data symbols are PAM-5 values) . The branch metric 
computations from a trellis diagram now accounts for 
25 the intersymbol interference due to the symbols 

transmitted two sample times before as well as the 
symbol transmitted during the last period. In one 
embodiment, the branch metrics computed by branch 
metric generator 1302 with decision feedback are given 
30 by: 

Mk,w(0) = [rk,w-aw,2Dk-i(-2) - ( -2 -20^, i) ] ^ ; 
Mk,w(l) = [rk,w-aw,2Dk-i (-1) - {-2-aw,i) ] ^; 
Mk,w(2) = [rk,w-aw,2Dk-i (0) - (-2) ] ^■ 
35 Mk,w(3) = [rk,w-aw,2Dk-i (1) - (-2+aw,i) ] ^; 

Mk,w(4) = [rk,w-aw,2Dk-i{2) - (-2 + 2aw,i) 
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Mk,w(5) = [rk,w-aw,2Dk-i (-2) - (-l-2aw,i) ] ^; 
Mk,w(6) = [rk,w-aw,2Dk-i (-1) - (-l-aw,i) ] ^; 
Mk,w(7) = [rk,w-aw,2Dk-i (0) - (-1) ]^; 
Mk,w(8) = [rk,w-aw,2Dk-i(l) - (-l+aw,i) 
Mk,w(9) = [rk,w-aw,2Dk-i(2) - (-l+2aw,i) ] ^• 
Mk,w(10) = [rk,w-aw,2Dk-i (-2) - {-2a^^^)]^; 
Mk,w{ll) = [rk,w-aw,2Dk-i (-1) - (-aw,i) ]^; 
Mk,w(12) = [rk,w-aw,2Dk-i (0) ] ^• 
Mk;w(13) = [irk,w-aw,2Dk-i (1) -aw,i] ^; 
Mk,w(14) = [rk,w-aw,2Dk-i (2) -2aw,i] ^• 
Mk,w(15) = [rk,w-aw,2Dk-i (-2) - (l-2aw,i) ] ^; 
Mk,vr(16) = [rk,w-aw,2Dk-i (-1) - (l-Ow^i) ] ^; 
Mk,w(17) = [rk,w-aw,2Dk-i (0) -1] ^• 
Mk,w(18) = [rk,w-aw,2Dk-i(l) - (l+aw,i) 
Mk,w(19) = [rk,w-aw,2Dk-i(2) - (l+2aw,i) ] 
Mk,w(20) = [rk,w-a„,2Dk-i(-2) - (2-2aw,i) 1^; 
Mk,w(21) = [rk,w-aw,2Dk-i(-l) - (2-aw,i) ] ^• 
Mk,w (22) = [rk,w-aw,2Dk-i (0) -2] ^• 
Mk,w(23) = trk,w-aw,2Dk-i(l) - (2+aw,i) 

Mk,w(24) = [rk,w-aw,2Dk-i(2) - (2+2aw,i) ] ^ (23) 



The ISI due to the transmitted symbol at time (k- 
2) is removed from the received sample rk,w before the 
branch metric of the sequence detector that accounts 
for the ISI due to the transmitted symbol at time (k-1) 
is computed. After this calculation, the previously 
described calculation is performed to remove the ISI 
due to the (k-l)th transmitted symbol. 

Add compare select ^-(^tCS^SOS then computes the 

state metrics Pk,w(j) and the comparison results Dk,w(j) 

as described above in ^quations-^^^ and^V^^ 

respectively. Traceback 13 04 accepts a starting point 

from startirig point determiner 1306, as described ..^ 
the <jc. tide's ponaiv\g c^s^r^ponenisof seQ.\iei/\ce doixc^oi- llOO m Ptgote uAs 
abovep^ arid outputs '^a sec of ^^ftcided^ni^^symbols tcf L.IFO 
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1305. LIFO 1305, then, outputs the resulting symbols 
in reverse chronological order from that received. 

D c 6 C 

Sequence detection in Combination with ^rror yforrection 

Although achieving excellent noise margins, the 
combination of sequence detection with error correction 
codes is problematic. Sequence detectors usually 
produce hard decisions (i.e., decisions that do not 
contain information on reliability) , which become input 
signals to error correcting codes . Most error 
correcting techniques, such as the parity coding or 4-D 
lattice coding proposed for Gigabit Ethernet, rely on 
soft decisions (i.e., decisions that contain 
reliability information) to achieve full performance. 
See, e.g., S. Lin and D. J. Costello, Jr., Error Control 
Coding: Fundamentals and Applications (1983) . Thus, a typical 
sequence detector in combination with a decoder using 
an error correcting code does not achieve the improved 
SNR margins of both the sequence detector and the error 
correcting code unless the decoder is provided with a 
soft decision from the sequence detector. 

Figure 14 shows a sequence detector 1400-w 
according to the present invention. Sequence detector 
1400-w is coupled to receive signal rk,w from wire w. 
Sequence detector 1400-w includes . branch metric 
generator 14 02-w, add compare select"^ ^C6)^ 1403 -w, and 
starting point determiner 1406 -w. Add compare select 
1402-w and starting point determiner 1406-w are each 
coupled to traceback 1404. 

Traceback 1404 is coupled to each wire w so that 
the traceback can be accomplished on N-D symbols rather 
than performing a separate traceback on N 1-D symbols, 
where N is the number of wires. Traceback 1404 is also 
coupled with LIFO 1405. LIFO 1405 outputs the final 
symbol stream a'k^w for each wire w. 
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/ Although ^ ya sequence detector according to the 
present invention can accommodate any symbol alphabet 
and any number of ISI symbols, /or example^ sequence 
detector 1400 shovm in Figure 14 is for a'PAM-5 
alphabet where input signals suffer the influence of 
one past ISI symbol (i.e., the ISI length is 1) . . . 
^quaTigGr ^^l40I-w^ ■ ac hac bocft pireviouoly-^dxaauoaG^ 



executes a transfer function E(Z) = '^^(l+aw^iZ"^) /f w (Z) 
and therefore sequence detector 1400 -w detects a signal 
that includes ISI from one past symbol . Branch metric 
generator 14 02-v^ therefore generates the branch 
metrics as described in Equation 16. 

Add compare select p^esi 14 03 -w computes the state 
metrics Pk,w(i) (i=-2 , -1 , 0 , 1 , 2 ) according to Equation 17 
and the ACS results Dk,w(i) according to Equation 18. 
Additionally, ACS 1403 -w computes a second best state 
metric p2k,w(i) / a second ACS result D2k,w(i), and a 
difference result Ak,w(i) . The second best state metric 
can be computed according to the equation 



/'2;t.>v(0= second minimum {pk-i,w(j) + Mk,w (5 {i + 2) + ( j +2) ) ) ; 
j={-2, -1, 0, 1, 2}, (24) 



where i={-2, -1, 0, 12}. The second ACS result can be 
computed according to 

D2,^^{i) = j if p2,^^{i) = p,^,^M + M,^^{5{i + 2) + C/ + 2)) , (25) 

* 

where i= { -2 , - 1 , 0 , 1 , 2 } and j = ( -2 , -1 , 0 , 1 , 2 } . Finally, 
the difference result can be computed according to 



A,..(0 = p2, .(0-A.^(0 - 



(26) 
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Traceback 14 04 receives the ACS results, the second ACS 

results, and the difference results from each state on 

each wire as well as a starting point signal from 

starting point determiner 1406 -w for each wire w. 

Figure 15 shows an embodiment of /av 4-D traceback 
TO r Use ^ 
1404 ^n ccjuibin - atioa v with a series of sequence detectors 

1400-w. is nndp^rsjtood t hat - ? — i ^ genoral ,^ ^or an N- 

wire configuration, traceback 1404^caGpled into N 

sequence detectors similar to that shown in Figure 14, 

one for each wire w. In Figure 15, traceback 1404 

includes a parity code decoder 1504 although other 

coding schemes can be used, provided that the coding 

scheme can correct symbols within one clock cycle. 

For exemplary purposes. Figure 15 shows a four- 

^^^^ parity-code decoder. Traceback 1404 includes a 



four wires. ^...Re^r*^ module 1501-1 through 1501-4 receives 
parameters Tjcw from add compare select 14 03 -w and 
starting point determiner 1406-w (Figure 14) , 
Parameters Tk^^ includes the add compare results Dk,w(i), 
D2k,w(i) and Ak,w(i)/ where i=(-2, -1, 0, 1, 2) for PAM-5 
signaling, as well as a starting point SPk,w for each 
wire w. As was discussed before, starting point 
determiner 1406-w chooses a starting point SPk,w/ which 
can be based on the state metrics Pk,w(i)/ for traceback 
1404. 

Traceback 1404 in Figure 15 traces back to arrive 
at the best sequence ak,w for wire w. For each clock 
cycle k, read module 1501-w arrives at a best symbol 
ak,w/ a second best symbol a2k,w and an associated 
reliability ek,w for each wire w. 

As described above, the 4-D parity coding scheme 
only transmits 4-D symbols having even parity. A 
single error in one 1-D symbol will cause the parity of 
the 4-D symbol to become odd. Similar to "4-D 
slicing", traceback 1404 recognizes the parity error 
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and makes corrections to the'\4. 1-D symbols from read 
modules 1501-1 through 1501-4 for clock cycle k based 
on the reliability of each of the 1-D symbols. 

Hagenauer has shown that, within a Viterbi 
decoder, the reliability of decision symbol paths 
merging at each state grows with the difference between 
the state metrics between the two paths. See J. 
Hagenauer and P. Hocher, ^^A Viterbi Algorithm with 
Soft-Decision Outputs and its Applications," Proc . 
GLOBECOM ^89, 1680-1686, November 198^. Similar to 
Hageauer's Soft Output Viterbi Algorithm (SOVA) , each 
of read modules 1501-1 through 1501-4 outputs the 
difference metric, i.e.^the reliability measure, 
between the best two paths entering each state, Sk,i 
through Ek,4, respectively. SOVA uses these metrics 
over a range of sample times within the trellis to 
output soft decisions for every symbol. 

However, 4-D parity traceback 14 04 can recognize 
when a single error occurs. Therefore, only the 
difference metrics at the time of the error are 
required to correct errors. Because the actual 
decoding is accomplished during traceback in each of 
sequence detectors 140-1 through 140-4, traceback 1404 
recognizes an error in its channel and corrects the 
error in its own sequence path. 

For each clock cycle k, traceback 1404 retrieves 
each of the first choice 1-D symbols ak,i through ak,4/ 
the second choice 1-D symbols a2k,i through a2k,4/ and 
the reliability measures ek,i through 8k 4/ and determines 
the finally decided^ 1-D symbols a k,i through ak,4- 

For each clock cycle k, parity check 1502 receives 
the first choice symbols ak,i through ak,4 from read 
modules 1501-1 through 1501-4, respectively, determines 
the parity of the resulting 4-D symbol and outputs a 
parity signal indicating the parity of the 4-D symbol. 
Error analysis 1503 receives reliability measures 8k, i 
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through 8k, 4 from read modules 1501-1 through 1501-4, 
respectively, determines which of the sequence 
detectors w has the least reliabili icating which 

result is most likely to be incorrect, and outputs a 
wire signal W indicating which symbol is most likely to 
be incorrect. Decoder 1504 receives the first choice 
symbols ak,i through ak,4/ the second choice symbols a2k,i 
through a2k,4/ the parity signal from parity check 1502, 
and the wire signal from error analysis 1503. 

If the parity signal indicates that the parity of 
the first choice 4-D symbol is even, then the first 
choice symbols ak,i through ak,4 are output as the 
finally decided symbols a'k,i through a'k,4. However, an 
odd parity indicates an error in one of the first 
choice symbols ak,i through ak,4. If the parity signal 
indicates an odd parity, the symbol indicated by the 
wire signal W is replaced by a corresponding one of 
second choice symbols a2k,i through a2k,4 and the 
resulting 4-D symbol is output as finally decided 
symbols a'k,i through a'k^4. 

Additionally, decoder 1504 informs read modules 
1501-1 through 1501-4 of the finally decided symbols 
a k,i through a'k,4 by indicating, for each of read 
modules 1501-1 through 1501-4, which of the first 
choice symbols or the second choice symbols was output 
as the finally decided symbols for clock cycle k. Read 
modules 1501-1 through 1501-4 can then traceback 
accordingly and output the first choice symbols, second 
choice symbols, and reliability measures for clock 
cycle k-1 (i.e., ak-1,1 through ak-1,4/ a2k-i,i through a2k- 
1,4/ and Sk-1,1 through Ek-i,4/ respectively) . 

In other words, read module 1501-w outputs the 
best possible step back ak,w/ the second best step back 
a2k,w/ and the reliability measure 8k, w for each wire for 
clock cycle k. Parity check 1502 performs a parity 
check on the best possible step back ak,w. Error 
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analysis 1503 determines the wire most likely to be 
incorrect. If the parity passes, decoder 1504 outputs 
the best possible step back ak,w for clock cycle k. If 
parity fails, then decoder 1504 replaces one of the 
best possible symbols with the associated second best 
symbol, based on which wire is most likely to be 
incorrect, and outputs the resulting 4-D symbol. The 
choice of best symbol or second best symbol for each 
wire w is communicated back to read module 1501-w so 
that read module 1501-w can use the appropriate symbol 
to step back to clock cycle k-1. The replacement 
choice^ then^ affects only one read module. Therefore, 
the next set of symbols will be affected in one read 
module only . 

As shown in Figure 14, the output symbols a'k,w are 
output to LIFO 1405, which time reverses the order of 
the symbol stream and outputs the resulting symbol 
stream a'^^^- 

One skilled in the art will recognize that in 
general a sequence detector according to this invention 
can accommodate any symbol alphabet and the effects of 
any number of ISI symbols. Additionally, the sequence 
detector may include decision feedback as shown in 
Figure 13 . 



Reduced Complexity Sequence Detection Using State 
Reduction 

If the alphabet size is large or if the ISI length 
at the sequence detector is large then sequence 
detector 1400 -w shown in Figure 14 and traceback 1404 
using parity coding shown in Figure 15 become 
impractical at high symbol rates. The number of states 
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required in read modules 1501-1 through 1501-4 is A"^ on 
each wire, where A represents the number of symbols in 
alphabet {a} and r| represents the ISI symbol length at 
the sequence detector (i.e.^at the input terminal of 
sequence detector 1400 in Figure 14) . With a PAM-5 
alphabet and ti=2 ISI symbols, each of read modules 
1501-1 through 1501-4 requires twenty five (25) states 
in order to perform sequence detection. A decoder 
utilizing a large number of states is expensive, 
difficult to implement, and consumes a lot of power. 

Figure 16 shows a sequence detector 1600 -w having 
reduced complexity sequence detection. In particular, 
sequence detector 1600 -w includes j^ra^ch metric 
generator 1602-w, add-compare-select-'^1603 -w, and 
starting point determiner 1605 -w. Traceback 1604 and 
LIFO 1606 are coupled into sequence detector 1600-2 as 
well as similar detectors coupled to the remaining N 
wires. As an example, sequence detector 1600-w is 
shown for the PAM-5 alphabet, although embodiments of 
sequence detector 1600-w can utilize other symbol 
alphabets as well. 

^;3Pfe^^ PAM-5 symbol alphabet can be segregated into 
two families, an odd family X having the PAM-5 symbols 
{-1/ +1} and an even family Y having the PAM-5 symbols 
{-2, 0, +2}. A detector state can now be defined as 
the previous r| families X or Y, as opposed to the 
previous r| PAM-5 symbols {-2, -1, 0, +1, +2}. 
Therefore, the number of states required for the PAM-5 
symbol alphabet with ti=2 ISI symbols is reduced from 25 
states to 4 states on each transmission channel w=l 
through L. For ^ four wire system (4-D decoding, for 
example), there are a total of sixteen (16) states 
instead of one hundred (100) states. 

Reduced state detection can be accomplished when 
the minimum squared distance between any two parallel 
branches of a state transition S->S' exceeds the minimum 
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squared distance between any two paths in the trellis. 
A parallel branch refers to transitions S— >S' between 
individual states through different symbols. For 
example, a state S = X can transition to a state S' = X 
5 through receipt of either a -1 symbol or a +1 symbol. 
The actual squared minimum distance between 
sequences does not decrease and thus the performance 
suffers little or no degradation from that of full 
state sequence detection. Gigabit Ethernet using a 
10 PAM-5 symbol set suffering ISI from two (2) symbols 
meets this criteria. 

Figure 17 shows a trellis diagram displaying the 
reduced state transitions and all parallel PAM-5 
transitions. In Figure 17, a state is represented by 
15 two consecutive symbols (reflecting an ISI length of 

2) . A transition from state S at time k-1 to state S' 
at time k has two or three parallel branches, depending 
upon whether the new symbol entering at state S' is in 
family X or family Y, For example, a transition from 
20 state XX at time k-1 to state XX at state k has two 

branches because the incoming symbol must be either a - 
1 or +1 PAM-5 symbol. A transition from state XX at 
time k-1 to a state XY at time k, however, indicates 
that either a -2, 0 or +2 symbol is received and 
25 therefore there are three branches . 

In Figure 16, equalizer 1601 -w can execute the 
transfer function 

E(Z) = (l+aiZ'^+a2Z"^) /f (^) . (27) 

30 

Therefore, the expected signal input to decoder system 
1600 is 

& 

rk,w =ak,w+aiak-i,w+0C2ak-2,w. (2/) 

35 
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Branch metric generator 1602 -w computes the branch 
metrics for the state transitions displayed in Figure 
17. In the reduced state trellis shown in Figure 17, 
branch metric 1602 -w first decides on which of the two 
5 or three branches of the transition from state S to 
state S' to assign to the state transition S->s' . The 
decision of which branch performs the S^s' transition 
is based on calculating a distance metric for each 
branch and choosing the branch having the lowest 
10 metric. For example, in the transition from state S=XX 
to state S'=XX branch metric generator first determines 
which of the two branches (-1 or +1) are traversed 
before calculating the metric. The decision of which 
branch is traversed is stored in branch decision 
15 Bjc,w (S->S' ) . The branch decision and the metric are both 
communicated to ACS 1603 -w. 

For each state S at k-1, symbols ak_i(S)and a^-aCS) 
are known based upon feedback from ACS 1603 -w to branch 
^etric ^enerator-^ jj SOa -i W ^ as shown in Figure 16. For 
20 each state transition S S' , branch metric generator 
takes the difference b^t^ween the input signal and the 
ISI portion of Equation''^ to obtain a difference 

9 

a(S^S') = rjcw - aiak-i,w (S) - a2ak_2,w(S). {2p) 

25 

The difference a is then compared with the symbols for 
each possible branch of the state transition S to S' . 
The symbol^chosen for the branch^ ^^ w (S->S ^"T ) is then 
assigned to the transition from .state S to state S' . 
3 0 i g chown in (^ Figure 18^ 5*t€r branch metrics can be 

computed for each transition S to S' according to the 
equation: 



Mk.„(S->S') = [rjc,w - a'k,w(S->S') 



30 



35 aiak-i,w (S) - a2ak-2,w(S) ] ^, 
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where the valid transitions (S— >'S') in Figure 18 are 

S-^S' - XXX, XXY, YXX. YXY, XYX, XYY, YYX and YYY. The 

^ wA^re each ""y^"' ^6'' and "C /?, ^ or 
notation "ABC" used above and p^AFigure iS-^indicates'^an 

S-^S' transition from S=AB to S'=BC. 

Add-compare-select 1603 -w receives the branch 

metrics Mk,„((S-^S') and branch decisions Bk,w(S->S') 

from branch metric generator 1602 -w and calculates the 

state metrics Pk,w(S') according to the equation 

I 

Pk,w(S') = minj={s} (Pk-i,w(j) + Mk,w(S^S')), (3/5) 

where j is equal to each S such that S->S' is allowable. 

Add-compare-select 1603-w also determines the ACS 
results for each of the four final states S' and 
communicates those results to traceback circuit 1604. 
The ACS result Dk,w(S') is the path resulting in state 
S' having the lowest metric M(S— >S'). Because there are 
only two allowed paths that result in state S' (see 
Figures 17 and 18) , the second best choice is 
automatically the path that is contraindicated by 
Dk,w(S') and need not be separately stored. 

The error Ak,w(S') is the difference in metrics 
between the two paths resulting in state S' : 

Ak.w{S' ) = |m(Si->S' ) -M(S2^S' ) I , (3/) 

where Si is one of the two initial states that 
transition to the final state S' and S2 is the other of 
the two initial states that transition to the final 
state S' . For example, from Figure 18, if S'=YX, then 
Si and S2 are the states XY and YY, respectively. 

Finally, the branch decisions of branch metric 
generator 1602-w are also communicated to traceback 
circuit 1604. Branch decision Blk,w(S') corresponds to 
the decision on the path S— >S' indicated by Dk,w(S') . 
Branch decision B2k,w(S') corresponds to the decision on 
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the path S— contraindicated by Dk,w{S'). Therefore, 
in the soft-decision process, if the traceback circuit 
1604 is altered to the second most likely path, the 
parallel path decision for the second most likely path 
is available to traceback circuit 1604. 

Traceback circuit 1604 can be the same as 
traceback 14 04 of Figure 15 except that read modules 
1501-1 through 1501-4 receive a different set of 
parameters Fk^w- In traceback circuit 1604, rk,w 
includes the ACS parameters Dk,w(Si), Ak,w(Si), Blk,w(Si), 
B2k,w(Si), where Si = (XX, XY, YX, YY) , and the starting 
point SPk,w from starting point determiner 1605-w. As 
described above, read modules 1501-1 through 1501-4 
store the ACS results in memory and, starting from 
starting point SPk,w determined by starting point 
determiner 1605, determine^ the most likely symbol ak,w 
and the second most likely symbol a2k,w for cloc k cycle , 
k, ^,An>^reliability measure'^indi eating the dif f erence^in 
distance metrics between the most likely symbol and the 
second most likely s ymbo l^^gk^ is also determined. ^ 

As is shown in Figure 15, read modules 1501-1 
through 1501-4 output the parameters ak,w to parity 
check 1502 and decoder 1504, parameters a2k,w to decoder 
1504, and parameters 8k, w to error analysis 1503. As 
was previously discussed, decoder 1504 outputs^^the 
best symbols a'k,w based on the parity check and informs 
read modules 1501-1 through 1501-4 of the choice. Read 
modules 1501-1 through 1501-4 then proceed to determine 
most likely and second most likely symbols for clock 
cycle k-1 until the traceback is complete. 

In sequence detector 1600 -w of Figure 16, the 
minimum squared distance between parallel branches of 
any transition S— >S ' should be at least twice as large 
as the minimum squared distance of the overall decoder . 
Because there is no protection between parallel branch 
decisions^g" ■-» 3" ' of sequence detector 1600-w, this 
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requirement on minimum squared distances should hold 
true in order to prevent the overall minimum distance 
from decreasing because of reduced state detection. 

As was previously discussed, the 4-D parity code 
provides 3 dB of coding gain, which doubles the squared 
minimum distance between possible paths. However, this 
code provides no protection between parallel branches 
of transitions along one wire. Therefore, this overall 
requirement on minimum distances prevents the minimum 
squared distance from decreasing because of reduced 
state detection. This requirement holds for Gigabit 
Ethernet standards, as described above. Although the 
requirement should hold in general, it may not be held 
for all embodiments of the invention . 



Simplified DFE 

Reduced sequence detection can also be 
accomplished utilizing decision feedback equalization 
(DFE) . However, a simplified DFE provides a simple and 
easy implementation for accomplishing the equalization 
process in the allotted time (8 ns in the example of 
gigabit transmission over four wires) . 

Figure 19 shows an example of a simplified 
decision feedback equalizer 1900. The simplified 
decision feedback equalizer includes ^a pre -.equalizer 
section 1901-,Aadder 1902,Aslicer 1903, ^ ^clays 1904 and > 
1905^ ^arna""5 gle.ctor IQOC L^ Pre-equalizer section 1901 
can be any equalizer structure that reduces the ISI 
length to L symbols. Pre-equalizer section 1901, 
therefore, executes the transfer function 
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where ai through are the multiplier coefficients of 

pre-equalizer section 1901 and f (Z) is the response of 

the input channel (see Equation 2 for the response of a 

transfer channel) . . / r ir v\ 

5 The output signaJ^f rom^^ f cedfoy^ i /arc L section 1901^ 

(] a^k 5 is input to adder 1902. Adder 1902 subtracts the 

signajy^from selector 1906,,.^^ a"^^^ f rom the output signal^ 

from feedforward section 1902^ The resulting 

signal^ a' ' ']c= a'k-a''k^is input to slicer 1903. 

10 Slicer 1903 outputs a symbol ak that is closest to the 

input signal a'''^. The feedback section 1905 (see also 

feedback section 811 of Figure 8) of decision feedback 

1904^-1 -thro ua^ 190^'L 
equalizer 1900 comprises delays^ ^ - 901 and 19 6- !^ and 

selector 1906. Selector 1906 receives each of L past 

15 symbols ak-i through a^-L and uses these symbols to 

access a lookup table. The lookup table holds values §i 

through ^q. The output signal Vbf selector 1906^(]aJ2k]) 

then is that one of through that corresponds to 

the combination of inputs a^-i through a^-L- The time 

2 0 required to look the results up in a look-up table is 

much less than the time required to perform the L 
^;p ul t i - pl 1 q'g^ and L additions required of the feedback 
section shown, for example, as feedback section 811 of 
Figure 8 . 

25 In some embodiments, selector 1906 receives the 

look-up values §i through as input signals. In some 
embodiments, the look-up values through are 
preset. The look-up values through can also be 
adaptively chosen to optimize performance of the 

3 0 receiver of which decision feedback equalizer 1900 is a 

part. In most embodiments, Q = where A is the size 
of the symbol alphabet . 

As an example, in a system using the PAM-5 
alphabet where L=2 , and Q is 25 there are twenty-five 
35 (25) lookup values (i.e., Q=25) . Because the 
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intersymbol interference in the input signal to adder 
1902 is the result of two (2) ISI symbols, 

a'k = ak + aak_i + Pak-2 + nk, (3^) 

where a and P are the interference parameters and nk is 
random noise. The twenty- five values for the look-up 
table, therefore, are given by: 
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The parameters a and p can be adaptively chosen 

and the table updated periodically by calculating the 

look-up values through and inputting them into 

selector 1906. When decision feedback equalizer 1900 

5 is utilized, for example, as equalizer 505-j in 

receiver 501-j of Figure 5B, look-up values through 

can be calculated by coefficient update 506-j and 

read into equalizer 505-j . 

Figure 20A shows a sequence detector 2000. 

10 Sequence detector 2000 can be any sequence detector 

system having feedback, including sequence detector 

1300 (Figure 13) and sequence detector 1600 (Figure 

16) . As before, sequence detector 2000 utilizes any 

symbol alphabet and includes trellis decoding for any 

15 number of past ISI symbols. , , ^ 

^eao eoce dl^Tec^o^ 2O0O 
Pre-equalizer section 2001-^eceives signal yic^w/ 

and executes a transfer function, such as that shown in 

Equation')^^ that removes the ISI influence from all 

but li past symbols. Feedback section 2003 outputs a 

2 0 signal al^ that removes the influence from an 

additional M past symbol^^based inputs from the 

ACS. Sequence detector^ therefore^ utd - ldso^ states 
describing the past L-M ISI symbols. Figure 12, for 
example, illustrates a trellis diagram for L-M = 1. 
25 Figures 17 and 18, for example, illustrate a trellis 

diagram for a reduced state sequence detector with L-M 
= 2 

oaors *n i^rafteh rnef nc ae^eraht^ OOf (302 1^02-^^ and /602-y\fj 
As^ nj dc^CLiboa boforG -^ branch metric generator 

2004 outputs a set of branch metrics Mk(S->S') for 

3 0 transitions between states S and state S' of the 

decoder. ACS 20a5 outputs the ACS results to traceback 
circuitry 2006,-^ the transition metrics to starting 
point 2007. Traceback circuit 2006 outputs the symbols 
decided by sequence detector 2000, in reverse 
35 chronological order, and LIFO 2 008 reverses the order 
of those symbols to output symbol stream ak „. 
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The output signals Sk,w outputted from ACS 2005 to 

feedback section 2003 are given by the traced back 

sequence from traceback circuit 2006. 

20Ai 

From Figure^J^^ if the past L symbols have been 
properly decoded than the influence of intersymbol 
interference will be completely canceled. In general, 
feedback section 2 003 can be any feedback structure. 
An example feedback section is feedback section 811 
shown in Figure 8. Feedback section 811, however, 
includes M multipliers (multipliers 806-1 through 806- 
M) and an M- input adder (adder 80 7) for the case of M 
ISI symbol cancellation. 

One embodiment of feedback section 2 003 includes 
feedback sections like feedback section 811. For 
Gigabit Ethernet, at symbol rates of 125 Mhz on each 
wire, the timing constraints of the sequence detector 
are severe. When "per-survivor processing" (see, e.gr., 
sequence detector 1300 of Figure 13) is ul^^^ cc^ bacl s. 
section 2 003 must include feedback section 811 repeated 
for each state of equalizer 2000 because the final 
state of equalizer 2000 is not determined until the 
latest decision of ACS 2005 (i.e., the parameters Sk,w 
are determined by ACS 2 005) . 

Figure 2 OB shows an embodiment of feedback section 
2003 that includes a look-up feedback section 2100. 
Look-up feedback section 2100 outputs an output signal 
a''k from look-up values through 4q in response to the 
ACS parameters Sk-i through Sk-L- Look-up values 
through can be preloaded into feedback section 2100 
or may be periodically adaptively chosen and read into 
feedback section 2100. Values for look-up values 
through §q for two ISI symbols and a^PAM-5 symbol 
alphabet are given above in Equation'*;?-^^ 

The embodiments discussed above are exemplary only 
and are not intended to be limiting. One skilled in 
the art will recognize multiple variations of these 
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embodiments that are intended to be included within the 
scope of this disclosure. As such, the invention is 
limited only by the following claims. 



